Sep 22 18:11:49 devstack cinder-volume[75023]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 18:11:49 devstack cinder-volume[75023]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 18:11:49 devstack cinder-volume[75023]: we strongly recommend against using it for new projects. Sep 22 18:11:49 devstack cinder-volume[75023]: If you are already using Eventlet, we recommend migrating to a different Sep 22 18:11:49 devstack cinder-volume[75023]: framework. For more detail see Sep 22 18:11:49 devstack cinder-volume[75023]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 18:11:49 devstack cinder-volume[75023]: import eventlet # noqa Sep 22 18:11:52 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:11:52 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:11:52 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:11:53 devstack cinder-volume[75023]: INFO dbcounter [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Registered counter for database cinder Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG oslo_db.sqlalchemy.engines [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG dbcounter [-] [75023] Writer thread running {{(pid=75023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:11:53 devstack cinder-volume[75023]: INFO cinder.rpc [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 18:11:53 devstack cinder-volume[75023]: INFO cinder.rpc [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG oslo_db.sqlalchemy.engines [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:11:53 devstack cinder-volume[75023]: INFO cinder.volume.manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Determined volume DB was empty at startup. Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG cinder.volume.manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75023) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 18:11:53 devstack cinder-volume[75023]: INFO cinder.volume.manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 18:11:53 devstack cinder-volume[75023]: WARNING stevedore.named [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 18:11:53 devstack cinder-volume[75023]: WARNING castellan.key_manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:11:53 devstack cinder-volume[75023]: WARNING cinder.keymgr.conf_key_mgr [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG cinder.volume.drivers.lvm [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75023) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 22 18:11:53 devstack cinder-volume[75023]: DEBUG oslo_concurrency.processutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75023) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_concurrency.processutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] CMD "cinder-rtstool verify" returned: 0 in 0.495s {{(pid=75023) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_db.sqlalchemy.engines [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:11:54 devstack cinder-volume[75023]: INFO cinder.rpc [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 22 18:11:54 devstack cinder-volume[75023]: INFO cinder.rpc [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 22 18:11:54 devstack cinder-volume[75023]: WARNING stevedore.named [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 18:11:54 devstack cinder-volume[75023]: WARNING castellan.key_manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:11:54 devstack cinder-volume[75023]: INFO cinder.volume.manager [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_db.sqlalchemy.engines [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:11:54 devstack cinder-volume[75023]: INFO oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Starting 1 workers Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Started child 75180 {{(pid=75023) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Full set of CONF: {{(pid=75023) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] ******************************************************************************** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Configuration options gathered from: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] ================================================================================ {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] allow_availability_zone_fallback = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] allow_compression_on_image_upload = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75180]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] allowed_direct_url_schemes = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] api_rate_limit = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] auth_strategy = keystone {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] az_cache_duration = 3600 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_availability_zone = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_host = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_stats_polling_interval = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backup_api_class = cinder.backup.api.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backup_name_template = backup-%s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backup_use_same_host = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backup_use_temp_snapshot = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] chap_password = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] chap_username = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_internal_tenant_project_id = 5ba83ad9869245d98fac85cc6ad4610d {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_internal_tenant_user_id = 355b9d8a3fbc4fd0b5dc2de03ecb6bf9 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cloned_volume_same_az = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cluster = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] compression_format = gzip {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] compute_api_class = cinder.compute.nova.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] config_dir = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] config_source = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] control_exchange = openstack {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] debug = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] default_availability_zone = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] default_group_type = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] default_volume_type = lvmdriver-1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] disk_geometry = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_client_cert = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_client_cert_key = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_data_namespace = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_ssl_cert_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_ssl_cert_verify = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] driver_use_ssl = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] enable_force_upload = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] enable_new_services = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] enable_unsupported_driver = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] enabled_backends = ['lvmdriver-1'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] enforce_multipath_for_image_xfer = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] filter_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_api_insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_api_ssl_compression = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_ca_certificates_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_catalog_info = image:glance:publicURL {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_num_retries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance_request_timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] goodness_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] graceful_shutdown_timeout = 5 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] group_api_class = cinder.group.api.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] host = devstack {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_compress_on_upload = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_conversion_address_space_limit = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_conversion_cpu_limit = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_conversion_disable = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_introspection_address_space_limit = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_introspection_cpu_limit = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_upload_use_cinder_backend = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_upload_use_internal_tenant = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_volume_cache_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_volume_cache_max_count = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] image_volume_cache_max_size_gb = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] init_host_max_objects_retrieval = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] instance_format = [instance: %(uuid)s] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iscsi_target_flags = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iscsi_write_cache = on {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iser_helper = tgtadm {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iser_ip_address = 192.168.122.153 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iser_port = 3260 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_color = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_config_append = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_dir = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_options = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_rotate_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_rotate_interval_type = days {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] log_rotation_type = none {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] max_age = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] max_logfile_count = 30 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] max_logfile_size_mb = 200 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] max_over_subscription_ratio = 20.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] message_reap_interval = 86400 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] message_ttl = 2592000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] migration_create_volume_timeout_secs = 300 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] monkey_patch = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] monkey_patch_modules = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] my_ip = 192.168.122.153 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] no_snapshot_gb_quota = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] num_iser_scan_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] num_shell_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] num_volume_device_scan_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] nvmeof_conn_info_version = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] nvmet_ns_id = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] nvmet_port_id = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_max_limit = 1000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_ext_list = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_listen = 0.0.0.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_listen_port = 8776 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_use_ssl = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] osapi_volume_workers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] per_volume_size_limit = -1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] periodic_fuzzy_delay = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] periodic_interval = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] project_id_regex = [0-9a-f\-]+ {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] public_endpoint = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] publish_errors = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_backup_gigabytes = 1000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_backups = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_gigabytes = 1000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_groups = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_snapshots = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] quota_volumes = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] rate_limit_burst = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] rate_limit_except_level = CRITICAL {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] rate_limit_interval = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] reinit_driver_count = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] replication_device = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] report_discard_supported = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] report_interval = 120 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] reservation_clean_interval = 86400 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] reservation_expire = 86400 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] reserved_image_namespaces = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] reserved_percentage = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] rpc_response_timeout = 120 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] run_external_periodic_tasks = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] scst_target_driver = iscsi {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] scst_target_iqn_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_down_time = 720 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] shell_completion = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75180]: INFO cinder.volume.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] snapshot_name_template = snapshot-%s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] snapshot_same_host = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] split_loggers = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] state_path = /opt/stack/data/cinder {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] storage_availability_zone = nova {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] storage_protocol = iSCSI {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] syslog_log_facility = LOG_USER {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_helper = lioadm {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_ip_address = 192.168.122.153 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_port = 3260 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_protocol = iscsi {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] target_secondary_ip_addresses = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] trace_flags = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] transfer_api_class = cinder.transfer.api.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] transport_url = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] until_refresh = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_chap_auth = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_default_quota_class = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_journal = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_json = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_multipath_for_image_xfer = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_stderr = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] use_syslog = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] verify_glance_signatures = enabled {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_api_class = cinder.volume.api.API {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_backend_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_clear = zero {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_clear_ionice = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_clear_size = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_copy_bps_limit = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_dd_blocksize = 1M {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_name_template = volume-%s {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_service_inithost_offload = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volume_usage_audit_period = month {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] zoning_mode = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_concurrency.disable_process_locking = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.auth_section = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.auth_type = password {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.auth_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.cache = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.include_service_catalog = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.interface = public {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_password = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcache_username = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.region_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.service_token_roles_required = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.service_type = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.backend = dogpile.cache.null {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.backend_argument = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.backend_expiration_time = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.config_prefix = cache.oslo {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.debug_cache_backend = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.enable_retry_client = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.enable_socket_keepalive = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.expiration_time = 600 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.hashclient_retry_attempts = 2 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_dead_retry = 300 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_pool_maxsize = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_sasl_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.password = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.proxies = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.redis_db = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.redis_server = localhost:6379 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.retry_attempts = 2 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.retry_delay = 0.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.socket_keepalive_count = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.socket_keepalive_idle = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.socket_keepalive_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.socket_timeout = 1.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.tls_allowed_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.tls_cafile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.tls_certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.tls_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.tls_keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cache.username = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] coordination.backend_url = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.asyncio_connection = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.asyncio_slave_connection = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.backend = sqlalchemy {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.connection = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.connection_debug = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.connection_parameters = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.connection_recycle_time = 3600 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.connection_trace = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.db_inc_retry_interval = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.db_max_retries = 20 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.db_max_retry_interval = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.db_retry_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.max_overflow = 50 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.max_pool_size = 5 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.max_retries = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.mysql_wsrep_sync_wait = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.pool_timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.retry_interval = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.slave_connection = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.sqlite_synchronous = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.synchronous_reader = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] database.use_db_reconnect = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_tracing.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.connection_string = messaging:// {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.es_doc_type = notification {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.es_scroll_size = 10000 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.es_scroll_time = 2m {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.filter_error_trace = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.hmac_keys = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.sentinel_service_name = mymaster {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.socket_timeout = 0.1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.trace_requests = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler.trace_sqlalchemy = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler_jaeger.process_tags = {} {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler_jaeger.service_name_prefix = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] profiler_otlp.service_name_prefix = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.enforce_new_defaults = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.policy_default_rule = default {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.policy_file = policy.yaml {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_policy.remote_timeout = 60.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.group = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.helper_command = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] privsep_osbrick.user = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.group = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.helper_command = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] cinder_sys_admin.user = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.auth_section = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.auth_type = password {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.cafile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.collect_timing = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.send_service_user_token = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.split_loggers = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.tls_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] service_user.tls_min_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.auth_section = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.auth_type = password {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.collect_timing = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.region_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.split_loggers = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.tls_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] glance.tls_min_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.backend_availability_zone = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.chap_password = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.chap_username = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.disk_geometry = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_client_cert = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_client_cert_key = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_data_namespace = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.driver_use_ssl = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.extra_capabilities = {} {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.filter_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.goodness_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iscsi_target_flags = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iscsi_write_cache = on {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iser_helper = tgtadm {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iser_port = 3260 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.lvm_mirrors = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.lvm_share_target = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.lvm_type = auto {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.num_shell_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.replication_device = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.report_discard_supported = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.reserved_percentage = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_helper = tgtadm {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_port = 3260 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_protocol = iscsi {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.trace_flags = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.unique_fqdn_network = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.use_chap_auth = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_backend_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_clear = zero {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_clear_ionice = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_clear_size = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volume_group = cinder-volumes {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_reports.file_event_handler = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_reports.log_dir = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.backend_availability_zone = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.backend_host = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.chap_password = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.chap_username = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.chiscsi_conf = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.disk_geometry = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_client_cert = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_data_namespace = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.driver_use_ssl = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.extra_capabilities = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.filter_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.goodness_function = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack sudo[75184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iser_helper = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack sudo[75184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iser_ip_address = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iser_port = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.iser_target_prefix = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.lvm_conf_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.lvm_mirrors = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.lvm_share_target = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.lvm_type = auto {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.num_shell_tries = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.nvmet_port_id = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.replication_device = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.report_discard_supported = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.reserved_percentage = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.scst_target_driver = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.storage_protocol = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_helper = lioadm {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_ip_address = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_port = 3260 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_protocol = iscsi {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.trace_flags = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.use_chap_auth = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_clear = zero {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_clear_size = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] lvmdriver-1.volumes_dir = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_notifications.driver = [] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_notifications.retry = -1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] key_manager.fixed_key = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.barbican_api_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.barbican_endpoint = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.barbican_endpoint_type = public {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.barbican_region_name = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.cafile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.collect_timing = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.number_of_retries = 60 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.retry_delay = 1 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.send_service_user_token = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.split_loggers = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.tls_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.tls_min_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.verify_ssl = True {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican.verify_ssl_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.auth_section = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.auth_type = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.cafile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.certfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.collect_timing = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.insecure = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.keyfile = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.split_loggers = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.timeout = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.tls_ciphers = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] barbican_service_user.tls_min_version = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.approle_role_id = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.approle_secret_id = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.auth_method = approle {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.auth_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.kv_mountpoint = secret {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.kv_path = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.kv_version = 2 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.namespace = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.root_token_id = **** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.ssl_ca_crt_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.timeout = 60.0 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.token_file = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.token_role = None {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.use_ssl = False {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:11:54 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] ******************************************************************************** {{(pid=75023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 18:11:55 devstack sudo[75184]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:55 devstack sudo[75306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:55 devstack sudo[75306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:55 devstack sudo[75306]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.254s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:11:55 devstack cinder-volume[75180]: INFO cinder.brick.local_dev.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:55 devstack sudo[75410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:11:55 devstack sudo[75410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:55 devstack sudo[75410]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG cinder.brick.local_dev.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75180) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 22 18:11:55 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:55 devstack sudo[75514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:55 devstack sudo[75514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:56 devstack sudo[75514]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:56 devstack sudo[75702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:56 devstack sudo[75702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:56 devstack sudo[75702]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:56 devstack sudo[75786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 22 18:11:56 devstack sudo[75786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:56 devstack sudo[75786]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:56 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:56 devstack sudo[75793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:11:56 devstack sudo[75793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:57 devstack sudo[75793]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:57 devstack sudo[75872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:11:57 devstack sudo[75872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:57 devstack sudo[75872]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:57 devstack sudo[75881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:11:57 devstack sudo[75881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:57 devstack sudo[75881]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:57 devstack sudo[75964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:57 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:57 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:57 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:58 devstack sudo[75968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:58 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:58 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:58 devstack cinder-volume[75180]: INFO cinder.volume.drivers.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:58 devstack sudo[75978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:58 devstack sudo[75978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:58 devstack sudo[75978]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:58 devstack sudo[75981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:11:58 devstack sudo[75981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:58 devstack sudo[75981]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:58 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:58 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:11:58 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:59 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:59 devstack sudo[75987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:11:59 devstack sudo[75987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:59 devstack sudo[75987]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:59 devstack sudo[75990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:11:59 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:11:59 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:11:59 devstack cinder-volume[75180]: INFO cinder.volume.driver [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Driver hasn't implemented _init_vendor_properties() Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG cinder.volume.driver [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75180) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_db.sqlalchemy.engines [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writer thread running {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG cinder.db.api [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Building query based on filter {{(pid=75180) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG cinder.image.image_utils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75180) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 18:11:59 devstack cinder-volume[75180]: INFO cinder.keymgr.migration [None req-fcc26579-5430-4e2d-a3d6-92623cb76300 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:11:59 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:11:59 devstack sudo[76031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:11:59 devstack sudo[76031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:00 devstack sudo[76031]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:00 devstack sudo[76035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:12:00 devstack sudo[76035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:00 devstack sudo[76035]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:00 devstack sudo[76038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:12:00 devstack sudo[76038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:00 devstack sudo[76038]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:00 devstack sudo[76041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:12:00 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:00 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:00 devstack cinder-volume[75180]: DEBUG cinder.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Notifying Schedulers of capabilities ... {{(pid=75180) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:12:01 devstack cinder-volume[75180]: INFO cinder.volume.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Driver initialization completed successfully. Sep 22 18:12:01 devstack cinder-volume[75180]: INFO cinder.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Initiating service 2 cleanup Sep 22 18:12:01 devstack cinder-volume[75180]: INFO cinder.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Service 2 cleanup completed. Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG cinder.service [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Creating RPC server for service cinder-volume {{(pid=75180) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG cinder.service [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75180) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 18:12:01 devstack cinder-volume[75180]: INFO cinder.volume.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:01 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:12:01 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:01 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:01 devstack sudo[76052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:12:01 devstack sudo[76052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:01 devstack sudo[76052]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:01 devstack sudo[76055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:12:01 devstack sudo[76055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:01 devstack sudo[76055]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:01 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:12:01 devstack sudo[76058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:12:01 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:12:02 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root Sep 22 18:12:02 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:12:02 devstack cinder-volume[75180]: INFO cinder.volume.manager [None req-fa223bfc-ce24-4aad-a23a-deb1f94e48d0 None None] Driver post RPC initialization completed successfully. Sep 22 18:12:04 devstack cinder-volume[75023]: DEBUG dbcounter [-] [75023] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:12:12 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writing DB stats cinder:SELECT=4 {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:12:12 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:12:17 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager._thread_info {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:12:17 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread count: 6 {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:12:17 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread info: [<_MainThread(MainThread, started 134877080387712)>, , , , , ] {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:13:17 devstack sudo[78655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:13:17 devstack sudo[78655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:13:17 devstack sudo[78655]: pam_unix(sudo:session): session closed for user root Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:13:17 devstack sudo[78658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:13:17 devstack sudo[78658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:13:17 devstack sudo[78658]: pam_unix(sudo:session): session closed for user root Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:13:17 devstack sudo[78661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:13:17 devstack sudo[78661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:13:17 devstack sudo[78661]: pam_unix(sudo:session): session closed for user root Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:13:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:13:18 devstack sudo[78664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:13:18 devstack sudo[78664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:13:18 devstack sudo[78664]: pam_unix(sudo:session): session closed for user root Sep 22 18:13:18 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:13:18 devstack cinder-volume[75180]: DEBUG cinder.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Notifying Schedulers of capabilities ... {{(pid=75180) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:13:18 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager._thread_info {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:13:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread count: 6 {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:13:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread info: [<_MainThread(MainThread, started 134877080387712)>, , , , , ] {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:14:12 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:14:17 devstack sudo[81675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:14:17 devstack sudo[81675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:14:17 devstack sudo[81675]: pam_unix(sudo:session): session closed for user root Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:14:17 devstack sudo[81678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:14:17 devstack sudo[81678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:14:17 devstack sudo[81678]: pam_unix(sudo:session): session closed for user root Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:14:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:14:17 devstack sudo[81681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:14:17 devstack sudo[81681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:14:18 devstack sudo[81681]: pam_unix(sudo:session): session closed for user root Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:14:18 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:14:18 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:14:18 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG cinder.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Notifying Schedulers of capabilities ... {{(pid=75180) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager._thread_info {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread count: 6 {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:14:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread info: [<_MainThread(MainThread, started 134877080387712)>, , , , , ] {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG cinder.volume.drivers.lvm [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Updating volume stats {{(pid=75180) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:15:17 devstack sudo[83876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 18:15:17 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:15:17 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:15:17 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:15:17 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:15:17 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:15:17 devstack sudo[83883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 18:15:17 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:15:17 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.236s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:15:17 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:15:18 devstack sudo[83886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 18:15:18 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:15:18 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root Sep 22 18:15:18 devstack cinder-volume[75180]: DEBUG oslo_concurrency.processutils [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75180) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:15:18 devstack cinder-volume[75180]: DEBUG cinder.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Notifying Schedulers of capabilities ... {{(pid=75180) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:15:18 devstack cinder-volume[75180]: DEBUG oslo_service.periodic_task [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] Running periodic task VolumeManager._thread_info {{(pid=75180) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:15:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread count: 6 {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:15:18 devstack cinder-volume[75180]: DEBUG cinder.volume.manager [None req-35f388e9-a5ce-4fbf-9213-a54137d5e3b6 None None] thread info: [<_MainThread(MainThread, started 134877080387712)>, , , , , ] {{(pid=75180) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:16:12 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writing DB stats cinder:SELECT=1 {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:12 devstack cinder-volume[75180]: DEBUG dbcounter [-] [75180] Writing DB stats cinder:UPDATE=1 {{(pid=75180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:15 devstack cinder-volume[75023]: INFO oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Caught SIGTERM, stopping children Sep 22 18:16:15 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Acquiring lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:15 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Acquired lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:15 devstack cinder-volume[75023]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Releasing lock "singleton_lock" {{(pid=75023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:15 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Stop services. {{(pid=75023) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 22 18:16:15 devstack cinder-volume[75023]: DEBUG oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Killing children. {{(pid=75023) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 22 18:16:15 devstack cinder-volume[75023]: INFO oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Waiting on 1 children to exit Sep 22 18:16:16 devstack cinder-volume[75180]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Acquiring lock "singleton_lock" {{(pid=75180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:16 devstack cinder-volume[75180]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Acquired lock "singleton_lock" {{(pid=75180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:16 devstack cinder-volume[75180]: DEBUG oslo_concurrency.lockutils [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Releasing lock "singleton_lock" {{(pid=75180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:16 devstack cinder-volume[75180]: WARNING amqp [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 18:16:16 devstack cinder-volume[75180]: WARNING amqp [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 18:16:16 devstack cinder-volume[75023]: INFO oslo_service.backend._eventlet.service [None req-e85ddb35-1825-47e1-8d8d-41e2f434a4bf None None] Child 75180 exited with status 0 Sep 22 18:16:16 devstack cinder-volume[85188]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 18:16:16 devstack cinder-volume[85188]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 18:16:16 devstack cinder-volume[85188]: we strongly recommend against using it for new projects. Sep 22 18:16:16 devstack cinder-volume[85188]: If you are already using Eventlet, we recommend migrating to a different Sep 22 18:16:16 devstack cinder-volume[85188]: framework. For more detail see Sep 22 18:16:16 devstack cinder-volume[85188]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 18:16:16 devstack cinder-volume[85188]: import eventlet # noqa Sep 22 18:16:18 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:18 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:18 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:19 devstack cinder-volume[85188]: INFO dbcounter [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Registered counter for database cinder Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_db.sqlalchemy.engines [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG dbcounter [-] [85188] Writer thread running {{(pid=85188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:16:19 devstack cinder-volume[85188]: INFO cinder.rpc [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 18:16:19 devstack cinder-volume[85188]: INFO cinder.rpc [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_db.sqlalchemy.engines [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:19 devstack cinder-volume[85188]: INFO cinder.volume.manager [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Determined volume DB was empty at startup. Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG cinder.volume.manager [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85188) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 18:16:19 devstack cinder-volume[85188]: INFO cinder.volume.manager [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 18:16:19 devstack cinder-volume[85188]: WARNING stevedore.named [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 18:16:19 devstack cinder-volume[85188]: WARNING castellan.key_manager [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:16:19 devstack cinder-volume[85188]: WARNING cinder.keymgr.conf_key_mgr [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:16:19 devstack cinder-volume[85188]: INFO cinder.volume.manager [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_db.sqlalchemy.engines [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:19 devstack cinder-volume[85188]: INFO oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Starting 1 workers Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Started child 85404 {{(pid=85188) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Full set of CONF: {{(pid=85188) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] ******************************************************************************** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Configuration options gathered from: {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] ================================================================================ {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] allow_availability_zone_fallback = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] allow_compression_on_image_upload = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] allowed_direct_url_schemes = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] api_rate_limit = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] auth_strategy = keystone {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_availability_zone = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_host = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_stats_polling_interval = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backup_api_class = cinder.backup.api.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backup_name_template = backup-%s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:19 devstack cinder-volume[85404]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backup_use_same_host = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backup_use_temp_snapshot = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] chap_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] chap_username = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_internal_tenant_project_id = 5ba83ad9869245d98fac85cc6ad4610d {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_internal_tenant_user_id = 355b9d8a3fbc4fd0b5dc2de03ecb6bf9 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cluster = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] compression_format = gzip {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] compute_api_class = cinder.compute.nova.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] config_dir = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] config_source = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] control_exchange = openstack {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] debug = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] default_availability_zone = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] default_group_type = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] default_volume_type = QuobyteHD {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] disk_geometry = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_client_cert = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_client_cert_key = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_data_namespace = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_ssl_cert_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_ssl_cert_verify = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] driver_use_ssl = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] enable_new_services = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] enable_unsupported_driver = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] enabled_backends = ['QuobyteHD'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] enforce_multipath_for_image_xfer = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] filter_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_api_insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_api_ssl_compression = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_ca_certificates_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_catalog_info = image:glance:publicURL {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_num_retries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance_request_timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] goodness_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] graceful_shutdown_timeout = 5 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] group_api_class = cinder.group.api.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] host = devstack {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_compress_on_upload = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_conversion_address_space_limit = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_conversion_cpu_limit = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_conversion_disable = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_introspection_address_space_limit = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_introspection_cpu_limit = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_upload_use_cinder_backend = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_upload_use_internal_tenant = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_volume_cache_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_volume_cache_max_count = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] init_host_max_objects_retrieval = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] instance_format = [instance: %(uuid)s] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iscsi_target_flags = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iscsi_write_cache = on {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iser_helper = tgtadm {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iser_ip_address = 192.168.122.153 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iser_port = 3260 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_color = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_config_append = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_dir = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_options = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_rotate_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_rotate_interval_type = days {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] log_rotation_type = none {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] max_age = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] max_logfile_count = 30 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] max_logfile_size_mb = 200 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] max_over_subscription_ratio = 20.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] message_reap_interval = 86400 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] message_ttl = 2592000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] monkey_patch = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] monkey_patch_modules = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] my_ip = 192.168.122.153 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] no_snapshot_gb_quota = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] num_iser_scan_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] num_shell_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] num_volume_device_scan_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] nvmeof_conn_info_version = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] nvmet_ns_id = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] nvmet_port_id = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_max_limit = 1000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_ext_list = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_listen_port = 8776 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_use_ssl = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] osapi_volume_workers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] per_volume_size_limit = -1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] periodic_fuzzy_delay = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] periodic_interval = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] public_endpoint = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] publish_errors = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_backup_gigabytes = 1000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_backups = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_gigabytes = 1000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_groups = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_snapshots = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] quota_volumes = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] rate_limit_burst = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] rate_limit_except_level = CRITICAL {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] rate_limit_interval = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] reinit_driver_count = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] replication_device = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] report_discard_supported = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] report_interval = 120 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] reservation_clean_interval = 86400 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] reservation_expire = 86400 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] reserved_image_namespaces = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] reserved_percentage = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85404]: INFO cinder.volume.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Starting volume driver QuobyteDriver (1.2.1) Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.remotefs [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85404) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] rpc_response_timeout = 120 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] run_external_periodic_tasks = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] scst_target_driver = iscsi {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] scst_target_iqn_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_down_time = 720 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] shell_completion = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] snapshot_name_template = snapshot-%s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] split_loggers = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] state_path = /opt/stack/data/cinder {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] storage_availability_zone = nova {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] storage_protocol = iSCSI {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] syslog_log_facility = LOG_USER {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_helper = lioadm {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_ip_address = 192.168.122.153 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_port = 3260 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_protocol = iscsi {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] target_secondary_ip_addresses = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] trace_flags = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] transport_url = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] until_refresh = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_chap_auth = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_default_quota_class = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_journal = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_json = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_multipath_for_image_xfer = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_stderr = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] use_syslog = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] verify_glance_signatures = enabled {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_api_class = cinder.volume.api.API {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_backend_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_clear = zero {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_clear_ionice = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_clear_size = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_copy_bps_limit = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_dd_blocksize = 1M {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_name_template = volume-%s {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_service_inithost_offload = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volume_usage_audit_period = month {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] zoning_mode = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.auth_section = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.auth_type = password {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.auth_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.cache = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.interface = public {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcache_username = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.region_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.service_type = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.backend = dogpile.cache.null {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.backend_argument = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.backend_expiration_time = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.config_prefix = cache.oslo {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.debug_cache_backend = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.enable_retry_client = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.enable_socket_keepalive = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.expiration_time = 600 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_dead_retry = 300 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_pool_maxsize = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_sasl_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.proxies = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.redis_db = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.redis_server = localhost:6379 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.retry_attempts = 2 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.retry_delay = 0.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.socket_keepalive_count = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.socket_keepalive_idle = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.socket_keepalive_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.socket_timeout = 1.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.tls_allowed_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.tls_cafile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.tls_certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.tls_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.tls_keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cache.username = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] coordination.backend_url = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.asyncio_connection = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.asyncio_slave_connection = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.backend = sqlalchemy {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.connection = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.connection_debug = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.connection_parameters = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.connection_recycle_time = 3600 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.connection_trace = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.db_inc_retry_interval = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.db_max_retries = 20 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.db_max_retry_interval = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.db_retry_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.max_overflow = 50 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.max_pool_size = 5 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.max_retries = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85404) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: WARNING cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.pool_timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.retry_interval = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.slave_connection = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.sqlite_synchronous = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.synchronous_reader = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] database.use_db_reconnect = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: WARNING cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Running cmd (subprocess): mount.quobyte {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_tracing.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.connection_string = messaging:// {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.es_doc_type = notification {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.es_scroll_size = 10000 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.es_scroll_time = 2m {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.filter_error_trace = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.hmac_keys = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.sentinel_service_name = mymaster {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.socket_timeout = 0.1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.trace_requests = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler.trace_sqlalchemy = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler_jaeger.process_tags = {} {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] profiler_otlp.service_name_prefix = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.enforce_new_defaults = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.policy_default_rule = default {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.policy_file = policy.yaml {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.group = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.helper_command = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] privsep_osbrick.user = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.group = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.helper_command = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] cinder_sys_admin.user = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.auth_section = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.auth_type = password {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.cafile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.collect_timing = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.send_service_user_token = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.split_loggers = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.tls_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] service_user.tls_min_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.auth_section = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.auth_type = password {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.collect_timing = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.region_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.split_loggers = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.tls_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] glance.tls_min_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.backend_availability_zone = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.chap_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.chap_username = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.disk_geometry = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_client_cert = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_data_namespace = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.driver_use_ssl = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.extra_capabilities = {} {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.filter_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.goodness_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iscsi_target_flags = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iser_helper = tgtadm {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iser_port = 3260 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_host = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_login = admin {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_mount_options = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_private_key = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_share_path = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.quobyte_volume_url = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.replication_device = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.report_discard_supported = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_helper = tgtadm {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_port = 3260 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_protocol = iscsi {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.trace_flags = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.use_chap_auth = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_backend_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_clear = zero {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_reports.file_event_handler = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_reports.log_dir = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.backend_availability_zone = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.backend_host = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.chap_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.chap_username = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.chiscsi_conf = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.disk_geometry = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_client_cert = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_data_namespace = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.driver_use_ssl = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.extra_capabilities = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.filter_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.goodness_function = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iser_helper = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iser_ip_address = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iser_port = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.iser_target_prefix = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_host = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_login = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_mount_options = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_password = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_private_key = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack quobyte-client[85405]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 18:16:20 devstack quobyte-client[85405]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_share_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_ssh_port = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.num_shell_tries = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.nvmet_port_id = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.replication_device = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.report_discard_supported = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=85404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.reserved_percentage = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.scst_target_driver = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: INFO cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 ... Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.storage_protocol = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a -c /etc/quobyte/client-cinder.cfg {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_helper = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_ip_address = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_port = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_prefix = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_protocol = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.trace_flags = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.use_chap_auth = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_clear = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_clear_size = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] QuobyteHD.volumes_dir = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a -c /etc/quobyte/client-cinder.cfg Sep 22 18:16:20 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_notifications.driver = [] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] key_manager.fixed_key = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.barbican_api_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.barbican_endpoint = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.barbican_endpoint_type = public {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.barbican_region_name = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.cafile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.collect_timing = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.number_of_retries = 60 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.retry_delay = 1 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.send_service_user_token = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.split_loggers = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.tls_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.tls_min_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.verify_ssl = True {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican.verify_ssl_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.auth_section = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.auth_type = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.cafile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.certfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.collect_timing = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.insecure = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.keyfile = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.split_loggers = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.timeout = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.tls_ciphers = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] barbican_service_user.tls_min_version = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.approle_role_id = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.approle_secret_id = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.auth_method = approle {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.auth_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.kv_mountpoint = secret {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.kv_path = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.kv_version = 2 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.namespace = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.root_token_id = **** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.ssl_ca_crt_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.timeout = 60.0 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.token_file = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.token_role = None {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.use_ssl = False {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:20 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] ******************************************************************************** {{(pid=85188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 18:16:20 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.469s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:20 devstack cinder-volume[85404]: INFO cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 succeeded Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=85404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.483s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:20 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:20 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:20 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:21 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.239s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.volume.driver [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Driver hasn't implemented _init_vendor_properties() Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.volume.driver [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5557746887207, 'free_capacity_gb': 1775.5557746887207, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85404) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_db.sqlalchemy.engines [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG dbcounter [-] [85404] Writer thread running {{(pid=85404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.db.api [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Building query based on filter {{(pid=85404) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.image.image_utils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85404) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.keymgr.migration [None req-d4c1b498-5c62-4486-b22c-8061094a1df9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=85404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=85404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:21 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:21 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:21 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.245s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Notifying Schedulers of capabilities ... {{(pid=85404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.volume.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Driver initialization completed successfully. Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Initiating service 3 cleanup Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Service 3 cleanup completed. Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.service [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Creating RPC server for service cinder-volume {{(pid=85404) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.service [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85404) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.volume.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=85404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=85404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:21 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:21 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:21 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:21 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.243s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:21 devstack cinder-volume[85404]: INFO cinder.volume.manager [None req-ef6df0b4-a0fe-4cb8-b335-43a5984cc1ea None None] Driver post RPC initialization completed successfully. Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=85404) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG cinder.volume.drivers.quobyte [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=85404) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85404) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:26 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:26 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:26 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG oslo_concurrency.processutils [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.217s {{(pid=85404) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:26 devstack cinder-volume[85404]: DEBUG cinder.manager [None req-00dda6d9-a2d5-4a6d-9586-654bf24cd403 None None] Notifying Schedulers of capabilities ... {{(pid=85404) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:16:29 devstack cinder-volume[85188]: DEBUG dbcounter [-] [85188] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:30 devstack cinder-volume[85188]: INFO oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Caught SIGTERM, stopping children Sep 22 18:16:30 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Acquiring lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:30 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Acquired lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:30 devstack cinder-volume[85188]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Releasing lock "singleton_lock" {{(pid=85188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:30 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Stop services. {{(pid=85188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 22 18:16:30 devstack cinder-volume[85188]: DEBUG oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Killing children. {{(pid=85188) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 22 18:16:30 devstack cinder-volume[85188]: INFO oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Waiting on 1 children to exit Sep 22 18:16:31 devstack cinder-volume[85404]: DEBUG dbcounter [-] [85404] Writing DB stats cinder:SELECT=3 {{(pid=85404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:31 devstack cinder-volume[85404]: DEBUG dbcounter [-] [85404] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85404) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:34 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Acquiring lock "singleton_lock" {{(pid=85404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:34 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Acquired lock "singleton_lock" {{(pid=85404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:34 devstack cinder-volume[85404]: DEBUG oslo_concurrency.lockutils [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Releasing lock "singleton_lock" {{(pid=85404) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:34 devstack cinder-volume[85404]: WARNING amqp [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 18:16:34 devstack cinder-volume[85404]: WARNING amqp [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 18:16:34 devstack cinder-volume[85188]: INFO oslo_service.backend._eventlet.service [None req-80c01737-c56a-4fee-b9ff-d3179053d8e4 None None] Child 85404 exited with status 0 Sep 22 18:16:35 devstack cinder-volume[85752]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 22 18:16:35 devstack cinder-volume[85752]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 18:16:35 devstack cinder-volume[85752]: we strongly recommend against using it for new projects. Sep 22 18:16:35 devstack cinder-volume[85752]: If you are already using Eventlet, we recommend migrating to a different Sep 22 18:16:35 devstack cinder-volume[85752]: framework. For more detail see Sep 22 18:16:35 devstack cinder-volume[85752]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 18:16:35 devstack cinder-volume[85752]: import eventlet # noqa Sep 22 18:16:37 devstack cinder-volume[85752]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 22 18:16:37 devstack cinder-volume[85752]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 22 18:16:37 devstack cinder-volume[85752]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 22 18:16:38 devstack cinder-volume[85752]: INFO dbcounter [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Registered counter for database cinder Sep 22 18:16:38 devstack cinder-volume[85752]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:38 devstack cinder-volume[85752]: DEBUG dbcounter [-] [85752] Writer thread running {{(pid=85752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:16:38 devstack cinder-volume[85752]: INFO cinder.rpc [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 18:16:38 devstack cinder-volume[85752]: INFO cinder.rpc [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:39 devstack cinder-volume[85752]: INFO cinder.volume.manager [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Determined volume DB was empty at startup. Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG cinder.volume.manager [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85752) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 22 18:16:39 devstack cinder-volume[85752]: WARNING stevedore.named [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 18:16:39 devstack cinder-volume[85752]: WARNING castellan.key_manager [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:16:39 devstack cinder-volume[85752]: WARNING cinder.keymgr.conf_key_mgr [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 18:16:39 devstack cinder-volume[85752]: INFO cinder.volume.manager [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_db.sqlalchemy.engines [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:39 devstack cinder-volume[85752]: INFO oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Starting 1 workers Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Started child 86046 {{(pid=85752) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Full set of CONF: {{(pid=85752) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] ******************************************************************************** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] Configuration options gathered from: {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] ================================================================================ {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] allow_availability_zone_fallback = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] allow_compression_on_image_upload = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] allowed_direct_url_schemes = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] api_rate_limit = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] auth_strategy = keystone {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_availability_zone = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_host = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_stats_polling_interval = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backup_api_class = cinder.backup.api.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backup_name_template = backup-%s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backup_use_same_host = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backup_use_temp_snapshot = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] chap_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[86046]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] chap_username = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_internal_tenant_project_id = 5ba83ad9869245d98fac85cc6ad4610d {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_internal_tenant_user_id = 355b9d8a3fbc4fd0b5dc2de03ecb6bf9 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cluster = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] compression_format = gzip {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] compute_api_class = cinder.compute.nova.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] config_dir = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] config_source = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] control_exchange = openstack {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] debug = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] default_availability_zone = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] default_group_type = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] default_volume_type = QuobyteHD {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] disk_geometry = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_client_cert = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_client_cert_key = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_data_namespace = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_ssl_cert_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_ssl_cert_verify = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] driver_use_ssl = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] enable_new_services = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] enable_unsupported_driver = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] enabled_backends = ['QuobyteHD'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] enforce_multipath_for_image_xfer = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] filter_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_api_insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_api_ssl_compression = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_ca_certificates_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_catalog_info = image:glance:publicURL {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_num_retries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance_request_timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] goodness_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] graceful_shutdown_timeout = 5 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] group_api_class = cinder.group.api.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] host = devstack {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_compress_on_upload = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_conversion_address_space_limit = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_conversion_cpu_limit = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_conversion_disable = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_introspection_address_space_limit = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_introspection_cpu_limit = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_upload_use_cinder_backend = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_upload_use_internal_tenant = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_volume_cache_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_volume_cache_max_count = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] image_volume_cache_max_size_gb = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] init_host_max_objects_retrieval = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] instance_format = [instance: %(uuid)s] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iscsi_target_flags = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iscsi_write_cache = on {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iser_helper = tgtadm {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iser_ip_address = 192.168.122.153 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iser_port = 3260 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_color = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_config_append = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_dir = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_options = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_rotate_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_rotate_interval_type = days {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] log_rotation_type = none {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] max_age = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] max_logfile_count = 30 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] max_logfile_size_mb = 200 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] max_over_subscription_ratio = 20.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] message_reap_interval = 86400 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] message_ttl = 2592000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] migration_create_volume_timeout_secs = 300 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] monkey_patch = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] monkey_patch_modules = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] my_ip = 192.168.122.153 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] no_snapshot_gb_quota = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] num_iser_scan_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] num_shell_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] num_volume_device_scan_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] nvmeof_conn_info_version = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] nvmet_ns_id = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] nvmet_port_id = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_max_limit = 1000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_ext_list = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_listen_port = 8776 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_use_ssl = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] osapi_volume_workers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] per_volume_size_limit = -1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] periodic_fuzzy_delay = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] periodic_interval = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] public_endpoint = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] publish_errors = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_backup_gigabytes = 1000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_backups = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_gigabytes = 1000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_groups = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_snapshots = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] quota_volumes = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] rate_limit_burst = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] rate_limit_except_level = CRITICAL {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] rate_limit_interval = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] reinit_driver_count = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] replication_device = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] report_discard_supported = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86046) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] report_interval = 120 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] reservation_clean_interval = 86400 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] reservation_expire = 86400 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] reserved_image_namespaces = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] reserved_percentage = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] rpc_response_timeout = 120 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] run_external_periodic_tasks = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] scst_target_driver = iscsi {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] scst_target_iqn_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_down_time = 720 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] shell_completion = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] snapshot_name_template = snapshot-%s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] split_loggers = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] state_path = /opt/stack/data/cinder {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] storage_availability_zone = nova {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] storage_protocol = iSCSI {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] syslog_log_facility = LOG_USER {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_helper = lioadm {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_ip_address = 192.168.122.153 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_port = 3260 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_protocol = iscsi {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] target_secondary_ip_addresses = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] trace_flags = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] transport_url = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] until_refresh = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_chap_auth = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_default_quota_class = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_journal = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_json = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_multipath_for_image_xfer = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_stderr = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] use_syslog = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] verify_glance_signatures = enabled {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_api_class = cinder.volume.api.API {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_backend_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_clear = zero {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_clear_ionice = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_clear_size = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_copy_bps_limit = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_dd_blocksize = 1M {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_name_template = volume-%s {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_service_inithost_offload = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volume_usage_audit_period = month {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] zoning_mode = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.auth_section = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.auth_type = password {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.auth_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.cache = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.include_service_catalog = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.interface = public {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcache_username = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.region_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.service_type = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.backend = dogpile.cache.null {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.backend_argument = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.backend_expiration_time = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.config_prefix = cache.oslo {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.debug_cache_backend = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.enable_retry_client = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.enable_socket_keepalive = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.expiration_time = 600 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_dead_retry = 300 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_pool_maxsize = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_sasl_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.proxies = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.redis_db = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.redis_server = localhost:6379 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.retry_attempts = 2 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.retry_delay = 0.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.socket_keepalive_count = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.socket_keepalive_idle = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.socket_keepalive_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.socket_timeout = 1.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.tls_allowed_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.tls_cafile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.tls_certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.tls_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.tls_keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cache.username = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] coordination.backend_url = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.asyncio_connection = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.asyncio_slave_connection = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.backend = sqlalchemy {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.connection = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.connection_debug = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.connection_parameters = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.connection_recycle_time = 3600 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.connection_trace = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.db_inc_retry_interval = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.db_max_retries = 20 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.db_max_retry_interval = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.db_retry_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.max_overflow = 50 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.max_pool_size = 5 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.max_retries = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.pool_timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.retry_interval = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.slave_connection = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.sqlite_synchronous = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.synchronous_reader = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] database.use_db_reconnect = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_tracing.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.connection_string = messaging:// {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.es_doc_type = notification {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.es_scroll_size = 10000 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.es_scroll_time = 2m {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.filter_error_trace = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.hmac_keys = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.sentinel_service_name = mymaster {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.socket_timeout = 0.1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.trace_requests = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler.trace_sqlalchemy = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler_jaeger.process_tags = {} {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] profiler_otlp.service_name_prefix = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.enforce_new_defaults = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.policy_default_rule = default {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.policy_file = policy.yaml {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.group = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.helper_command = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] privsep_osbrick.user = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86046) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 22 18:16:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 22 18:16:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.group = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.helper_command = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Running cmd (subprocess): mount.quobyte {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] cinder_sys_admin.user = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.auth_section = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.auth_type = password {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.cafile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.collect_timing = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.send_service_user_token = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.split_loggers = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.tls_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] service_user.tls_min_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.auth_section = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.auth_type = password {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.collect_timing = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.region_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.split_loggers = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.tls_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] glance.tls_min_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.backend_availability_zone = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.chap_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.chap_username = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.disk_geometry = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_client_cert = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_client_cert_key = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_data_namespace = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.driver_use_ssl = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.extra_capabilities = {} {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.filter_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.goodness_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iscsi_target_flags = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iscsi_write_cache = on {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iser_helper = tgtadm {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iser_port = 3260 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_host = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_login = admin {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_mount_options = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_private_key = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_share_path = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.num_shell_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.quobyte_volume_url = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.replication_device = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.report_discard_supported = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.reserved_percentage = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_helper = tgtadm {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_port = 3260 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_protocol = iscsi {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.trace_flags = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.unique_fqdn_network = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.use_chap_auth = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_backend_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_clear = zero {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_clear_ionice = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_clear_size = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_reports.file_event_handler = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_reports.log_dir = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.backend_availability_zone = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.backend_host = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.chap_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.chap_username = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.chiscsi_conf = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.disk_geometry = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_client_cert = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_data_namespace = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.driver_use_ssl = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.extra_capabilities = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.filter_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.goodness_function = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iser_helper = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack quobyte-client[86050]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 18:16:39 devstack quobyte-client[86050]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iser_ip_address = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iser_port = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.iser_target_prefix = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_host = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_login = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_mount_options = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_password = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_private_key = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_share_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_ssh_port = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.num_shell_tries = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.nvmet_port_id = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.replication_device = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.report_discard_supported = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.reserved_percentage = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.scst_target_driver = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.storage_protocol = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_helper = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_ip_address = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_port = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_prefix = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_protocol = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.trace_flags = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.use_chap_auth = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_clear = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_clear_size = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] QuobyteHD.volumes_dir = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_notifications.driver = [] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] key_manager.fixed_key = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.barbican_api_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.barbican_endpoint = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.barbican_endpoint_type = public {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.barbican_region_name = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.cafile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.collect_timing = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.number_of_retries = 60 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.retry_delay = 1 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.send_service_user_token = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.split_loggers = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.tls_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.tls_min_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.verify_ssl = True {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican.verify_ssl_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.auth_section = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.auth_type = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.cafile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.certfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.collect_timing = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.insecure = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.keyfile = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.split_loggers = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.timeout = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.tls_ciphers = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] barbican_service_user.tls_min_version = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.approle_role_id = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.approle_secret_id = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.auth_method = approle {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.auth_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.kv_mountpoint = secret {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.kv_path = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.kv_version = 2 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.namespace = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.root_token_id = **** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.ssl_ca_crt_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.timeout = 60.0 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.token_file = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.token_role = None {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.use_ssl = False {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 22 18:16:39 devstack cinder-volume[85752]: DEBUG oslo_service.backend._eventlet.service [None req-fd3299d8-9ac4-453f-9bb9-48db3079a9d5 None None] ******************************************************************************** {{(pid=85752) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 22 18:16:39 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.279s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:39 devstack cinder-volume[86046]: INFO cinder.volume.driver [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Driver hasn't implemented _init_vendor_properties() Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.driver [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5557746887207, 'free_capacity_gb': 1775.5557746887207, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86046) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writer thread running {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.db.api [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Building query based on filter {{(pid=86046) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86046) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:39 devstack cinder-volume[86046]: INFO cinder.keymgr.migration [None req-d2ae2a3d-dbac-4b66-a6dd-fd483f387a5c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 18:16:39 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:39 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:40 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:16:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Driver initialization completed successfully. Sep 22 18:16:40 devstack cinder-volume[86046]: INFO cinder.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Initiating service 3 cleanup Sep 22 18:16:40 devstack cinder-volume[86046]: INFO cinder.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Service 3 cleanup completed. Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG cinder.service [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Creating RPC server for service cinder-volume {{(pid=86046) start /opt/stack/cinder/cinder/service.py:231}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG cinder.service [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86046) start /opt/stack/cinder/cinder/service.py:237}} Sep 22 18:16:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:16:40 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:16:40 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:16:40 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Sep 22 18:16:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:16:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-685bb382-d7c1-4a5f-bbd5-408a93416e1e None None] Driver post RPC initialization completed successfully. Sep 22 18:16:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:16:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 6 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:16:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:16:49 devstack cinder-volume[85752]: DEBUG dbcounter [-] [85752] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:16:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Flow 'volume_create_manager' (b79da259-f26d-47b3-bc4d-2c55791f6bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d95c40-e86c-4a65-869e-27d89f85aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d95c40-e86c-4a65-869e-27d89f85aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1529493952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b987e5c6-a392-4f6c-b665-94a3b26f6076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfb768b81749969ce1ce5f3cebe4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:17:38Z,use_quota=True,user_id='5168503c39a54f9ea7ca601acad81d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47721b1-b563-460a-aa16-79241ccc470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47721b1-b563-460a-aa16-79241ccc470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8d7fd-22c4-4bd1-b462-143fed0832ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8d7fd-22c4-4bd1-b462-143fed0832ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b987e5c6-a392-4f6c-b665-94a3b26f6076', 'volume_name': 'volume-b987e5c6-a392-4f6c-b665-94a3b26f6076', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6a6df5-1134-4bdd-8296-b94b6f888d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6a6df5-1134-4bdd-8296-b94b6f888d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e17bbdd-adcb-4b45-bcd7-6d028aca7317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:37 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Volume b987e5c6-a392-4f6c-b665-94a3b26f6076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b987e5c6-a392-4f6c-b665-94a3b26f6076', 'volume_size': 1} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1529493952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b987e5c6-a392-4f6c-b665-94a3b26f6076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfb768b81749969ce1ce5f3cebe4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:17:38Z,use_quota=True,user_id='5168503c39a54f9ea7ca601acad81d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Creating volume b987e5c6-a392-4f6c-b665-94a3b26f6076 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:17:37 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:17:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:17:37 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 1073741824 Sep 22 18:17:37 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:17:38 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Sep 22 18:17:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 1073741824" returned: 0 in 0.716s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:17:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:17:38 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 Sep 22 18:17:38 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:17:39 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076" returned: 0 in 0.324s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e17bbdd-adcb-4b45-bcd7-6d028aca7317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b987e5c6-a392-4f6c-b665-94a3b26f6076', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed95979-fc7f-4c5c-9576-c9bc5fc69de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:17:39 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Volume volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 (b987e5c6-a392-4f6c-b665-94a3b26f6076): created successfully Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed95979-fc7f-4c5c-9576-c9bc5fc69de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:17:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Flow 'volume_create_manager' (b79da259-f26d-47b3-bc4d-2c55791f6bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:17:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e5662d78-8efd-456d-ad2e-c346e08be5cf tempest-TaggedAttachmentsTest-2085404727 None] Created volume successfully. Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:17:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:17:48 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:17:48 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:17:49 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.545s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 6 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:17:49 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Flow 'volume_create_manager' (abab1916-dfae-4c8c-a3d0-a95065fb7e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b72d460-69f2-49cc-af57-dd9fdcc1f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b72d460-69f2-49cc-af57-dd9fdcc1f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-214856454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfb5086-19a6-4ee8-a439-bbc02a3329a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30bea6909145129cb8a64eed661e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:18:05Z,use_quota=True,user_id='1fef4e16e32e4b99a2fe4e0691a96eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33417728-9dbc-457c-9b0b-07ef9b41e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33417728-9dbc-457c-9b0b-07ef9b41e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9097b609-c58d-4ca4-9a75-ce9ca6b3af40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9097b609-c58d-4ca4-9a75-ce9ca6b3af40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfb5086-19a6-4ee8-a439-bbc02a3329a3', 'volume_name': 'volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d4c81-5db0-4b08-9daf-05cb98868447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d4c81-5db0-4b08-9daf-05cb98868447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8a733a-4000-4304-bbba-28bfcd48ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Volume bbfb5086-19a6-4ee8-a439-bbc02a3329a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3', 'volume_size': 1} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-214856454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfb5086-19a6-4ee8-a439-bbc02a3329a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab30bea6909145129cb8a64eed661e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:18:05Z,use_quota=True,user_id='1fef4e16e32e4b99a2fe4e0691a96eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Creating volume bbfb5086-19a6-4ee8-a439-bbc02a3329a3 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:18:05 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:18:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:05 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 1073741824 Sep 22 18:18:05 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:06 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 1073741824" returned: 0 in 0.980s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:06 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 Sep 22 18:18:06 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:07 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" returned: 0 in 0.650s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8a733a-4000-4304-bbba-28bfcd48ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6ae96-cc2d-40d2-b238-0b04130e91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Volume volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 (bbfb5086-19a6-4ee8-a439-bbc02a3329a3): created successfully Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6ae96-cc2d-40d2-b238-0b04130e91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Flow 'volume_create_manager' (abab1916-dfae-4c8c-a3d0-a95065fb7e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:18:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e3db9b49-e6e5-4eaa-afa0-b9b5459103ca tempest-VolumesAdminNegativeTest-1176167540 None] Created volume successfully. Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Acquiring lock "cinder-bbfb5086-19a6-4ee8-a439-bbc02a3329a3-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:18:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "cinder-bbfb5086-19a6-4ee8-a439-bbc02a3329a3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:18:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Acquiring lock "cinder-quobyte-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:18:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "cinder-quobyte-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" acquired by "delete_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:18:08 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsxvx_xb7/privsep.sock'] Sep 22 18:18:08 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsxvx_xb7/privsep.sock Sep 22 18:18:08 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: Sep 22 18:18:09 devstack cinder-volume[86046]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 22 18:18:09 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:09 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Spawned new privsep daemon via rootwrap Sep 22 18:18:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Accepted privsep connection to /tmp/tmpsxvx_xb7/privsep.sock {{(pid=86046) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 22 18:18:09 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 22 18:18:09 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 22 18:18:09 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 22 18:18:09 devstack cinder-volume[86046]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87225 Sep 22 18:18:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4bc23b-fce1-4aa4-a1da-ba557c6601a7]: (2,) {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:18:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846cb7e-ec21-452e-b973-f00675bbe764]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:18:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:10 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 Sep 22 18:18:10 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:10 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" returned: 0 in 0.907s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:10 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3 Sep 22 18:18:10 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:11 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" returned: 0 in 0.523s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "cinder-quobyte-bbfb5086-19a6-4ee8-a439-bbc02a3329a3" released by "delete_volume" :: held 3.230s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:18:11 devstack cinder-volume[86046]: WARNING cinder.quota [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:18:11 devstack cinder-volume[86046]: WARNING cinder.quota [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Created reservations ['06dc4534-85be-4c5e-a6a8-460bb7c46973', '1a01105e-d716-42a3-867b-a07252bedaff', 'f14b3224-1447-4b4e-989b-5a1a4051c5a3', '7a7b3c4c-6fdd-413b-ab22-7681ae754d3a'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:11 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:18:11 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:11 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.398s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:18:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Deleted volume successfully. Sep 22 18:18:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32adb8d0-3f11-42f5-ae8b-49e493feb9dc tempest-VolumesAdminNegativeTest-1176167540 None] Lock "cinder-bbfb5086-19a6-4ee8-a439-bbc02a3329a3-delete_volume" released by "delete_volume" :: held 4.032s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:18:21 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=17,cinder:SELECT=7,cinder:INSERT=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Flow 'volume_create_manager' (a0f31f32-b2e9-42ac-89ad-041bf5a9d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace7344f-add1-4ca8-9365-a0b407bd0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace7344f-add1-4ca8-9365-a0b407bd0c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-180059272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609c79c2-03f7-43b6-bf93-6439d7b7623e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3024e4bf6e4fde9d502a84615097a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:18:22Z,use_quota=True,user_id='bc18f71d909e4278a159deadffdeb721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db630eef-7401-4adb-8a97-900ba1c23f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db630eef-7401-4adb-8a97-900ba1c23f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e26e52-12b4-46c8-a455-ee1438701fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e26e52-12b4-46c8-a455-ee1438701fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609c79c2-03f7-43b6-bf93-6439d7b7623e', 'volume_name': 'volume-609c79c2-03f7-43b6-bf93-6439d7b7623e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d936e-5507-47e9-a20b-d220b305ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d936e-5507-47e9-a20b-d220b305ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e459a0-2d9d-4c0d-837d-cf96d71b1d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:22 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Volume 609c79c2-03f7-43b6-bf93-6439d7b7623e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609c79c2-03f7-43b6-bf93-6439d7b7623e', 'volume_size': 1} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-180059272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609c79c2-03f7-43b6-bf93-6439d7b7623e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3024e4bf6e4fde9d502a84615097a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:18:22Z,use_quota=True,user_id='bc18f71d909e4278a159deadffdeb721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Creating volume 609c79c2-03f7-43b6-bf93-6439d7b7623e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:18:22 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:18:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:22 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e 1073741824 Sep 22 18:18:22 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:23 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e 1073741824" returned: 0 in 0.811s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:23 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e Sep 22 18:18:23 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:23 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e459a0-2d9d-4c0d-837d-cf96d71b1d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609c79c2-03f7-43b6-bf93-6439d7b7623e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d734832-a6e5-4539-88e2-b3d2f6c4e975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:18:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Volume volume-609c79c2-03f7-43b6-bf93-6439d7b7623e (609c79c2-03f7-43b6-bf93-6439d7b7623e): created successfully Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d734832-a6e5-4539-88e2-b3d2f6c4e975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:18:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Flow 'volume_create_manager' (a0f31f32-b2e9-42ac-89ad-041bf5a9d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:18:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-edb0037a-419c-40e7-a86e-c1bd0f2848e6 tempest-ServerActionsTestOtherA-479923576 None] Created volume successfully. Sep 22 18:18:33 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:18:34 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:18:48 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:18:48 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:18:48 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 8 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:18:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:18:49 devstack cinder-volume[86046]: WARNING py.warnings [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 22 18:18:49 devstack cinder-volume[86046]: .first() Sep 22 18:18:49 devstack cinder-volume[86046]: Sep 22 18:18:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:18:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:18:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:18:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-b987e5c6-a392-4f6c-b665-94a3b26f6076', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38b5b223-f9b7-49bc-a4e4-33c89c45650e', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:18:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-a2a3a9c6-8c30-403a-b813-20356cad6e4e req-9bcd3eb1-863a-472d-b694-aed45262b876 tempest-TaggedAttachmentsTest-2085404727 None] attachment_update completed successfully. Sep 22 18:18:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-f9cf5961-9330-4ffd-bf91-4a8eec1324c7 req-636e67c3-d088-45d2-a78b-db283ceaa3c2 tempest-TaggedAttachmentsTest-2085404727 None] Terminate volume connection completed successfully. Sep 22 18:18:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-f9cf5961-9330-4ffd-bf91-4a8eec1324c7 req-636e67c3-d088-45d2-a78b-db283ceaa3c2 tempest-TaggedAttachmentsTest-2085404727 None] Deleting attachment 38b5b223-f9b7-49bc-a4e4-33c89c45650e. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:19:04 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:04 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=8 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-14564730-9a90-410f-a87e-1dc4663b06aa req-ca5c57d0-96cc-4caa-9ac5-da486a9ac00c tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-14564730-9a90-410f-a87e-1dc4663b06aa req-ca5c57d0-96cc-4caa-9ac5-da486a9ac00c tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-14564730-9a90-410f-a87e-1dc4663b06aa req-ca5c57d0-96cc-4caa-9ac5-da486a9ac00c tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-14564730-9a90-410f-a87e-1dc4663b06aa req-ca5c57d0-96cc-4caa-9ac5-da486a9ac00c tempest-ServerActionsTestOtherA-479923576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-609c79c2-03f7-43b6-bf93-6439d7b7623e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9092055b-f6bc-4061-b51f-4fd5b356ac46', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:19:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-14564730-9a90-410f-a87e-1dc4663b06aa req-ca5c57d0-96cc-4caa-9ac5-da486a9ac00c tempest-ServerActionsTestOtherA-479923576 None] attachment_update completed successfully. Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "cinder-b987e5c6-a392-4f6c-b665-94a3b26f6076-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "cinder-b987e5c6-a392-4f6c-b665-94a3b26f6076-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "cinder-quobyte-b987e5c6-a392-4f6c-b665-94a3b26f6076" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "cinder-quobyte-b987e5c6-a392-4f6c-b665-94a3b26f6076" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7fcc1-5d34-4076-b225-ebfb055c291b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:19:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:09 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 Sep 22 18:19:09 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:10 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076" returned: 0 in 0.741s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:10 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076 Sep 22 18:19:10 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:10 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b987e5c6-a392-4f6c-b665-94a3b26f6076" returned: 0 in 0.529s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "cinder-quobyte-b987e5c6-a392-4f6c-b665-94a3b26f6076" released by "delete_volume" :: held 1.363s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Created reservations ['7814e5c5-b4b3-49bf-9579-7dce6a523fc0', 'f15a8562-1abb-4549-aea0-8bd6fb89bbe1', 'ec607441-2b62-4e16-860d-e9be4bca49e7', 'af36bde5-d59a-4c30-990b-3938012df3cb'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:11 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:19:11 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:11 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.314s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:19:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Deleted volume successfully. Sep 22 18:19:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3c23220-7dca-4d32-82f3-0051a5fd3c06 tempest-TaggedAttachmentsTest-2085404727 None] Lock "cinder-b987e5c6-a392-4f6c-b665-94a3b26f6076-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-1a1af581-551b-4a2a-b082-3b89e91ee76e tempest-ServerActionsTestOtherA-479923576 None] Terminate volume connection completed successfully. Sep 22 18:19:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-1a1af581-551b-4a2a-b082-3b89e91ee76e tempest-ServerActionsTestOtherA-479923576 None] Deleting attachment 9092055b-f6bc-4061-b51f-4fd5b356ac46. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:19:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-97532efd-7535-49e7-9689-5174556a36cb tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-97532efd-7535-49e7-9689-5174556a36cb tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-97532efd-7535-49e7-9689-5174556a36cb tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-97532efd-7535-49e7-9689-5174556a36cb tempest-ServerActionsTestOtherA-479923576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-609c79c2-03f7-43b6-bf93-6439d7b7623e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0c256e7-807b-4eda-beab-8a149784fbc8', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:19:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8a7d965d-7b24-42a0-a849-c470b31f233f req-97532efd-7535-49e7-9689-5174556a36cb tempest-ServerActionsTestOtherA-479923576 None] attachment_update completed successfully. Sep 22 18:19:23 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:23 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Flow 'volume_create_manager' (9351afe0-06a3-4181-9573-c83065065ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83abe0b9-3698-4a5b-bb94-73455da3f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83abe0b9-3698-4a5b-bb94-73455da3f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1965644142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2742cca4-0c25-44d3-99b9-ae9eb647092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b6f81598c14e039dfdaaa3528f962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:25Z,use_quota=True,user_id='ea919849dbca4beba32f01cb42ac0107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e6e14c-169f-44b4-83bb-4821a9a52ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e6e14c-169f-44b4-83bb-4821a9a52ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109f11ee-fdaf-4810-a0a2-d4b28f2f204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109f11ee-fdaf-4810-a0a2-d4b28f2f204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2742cca4-0c25-44d3-99b9-ae9eb647092e', 'volume_name': 'volume-2742cca4-0c25-44d3-99b9-ae9eb647092e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4139b2-569a-4bf0-892f-4162d3c55b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4139b2-569a-4bf0-892f-4162d3c55b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145a07f0-52ad-433f-bc14-9d9d729491be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Volume 2742cca4-0c25-44d3-99b9-ae9eb647092e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2742cca4-0c25-44d3-99b9-ae9eb647092e', 'volume_size': 1} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1965644142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2742cca4-0c25-44d3-99b9-ae9eb647092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b6f81598c14e039dfdaaa3528f962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:25Z,use_quota=True,user_id='ea919849dbca4beba32f01cb42ac0107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Creating volume 2742cca4-0c25-44d3-99b9-ae9eb647092e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:19:25 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:19:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:25 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e 1073741824 Sep 22 18:19:25 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:26 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e 1073741824" returned: 0 in 0.835s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:26 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e Sep 22 18:19:26 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:26 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e" returned: 0 in 0.314s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145a07f0-52ad-433f-bc14-9d9d729491be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2742cca4-0c25-44d3-99b9-ae9eb647092e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403c147f-a5d9-4d6f-83dd-9c6b4ed7f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Volume volume-2742cca4-0c25-44d3-99b9-ae9eb647092e (2742cca4-0c25-44d3-99b9-ae9eb647092e): created successfully Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403c147f-a5d9-4d6f-83dd-9c6b4ed7f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Flow 'volume_create_manager' (9351afe0-06a3-4181-9573-c83065065ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-39af8f6d-ebd2-43a0-a72d-1f02d4187034 tempest-DeleteServersTestJSON-225385022 None] Created volume successfully. Sep 22 18:19:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7001cabb-ad23-4155-a221-b1f1a6ef7f2c req-c615079b-2289-4e06-a546-c04c6ab16007 tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7001cabb-ad23-4155-a221-b1f1a6ef7f2c req-c615079b-2289-4e06-a546-c04c6ab16007 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7001cabb-ad23-4155-a221-b1f1a6ef7f2c req-c615079b-2289-4e06-a546-c04c6ab16007 tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-7001cabb-ad23-4155-a221-b1f1a6ef7f2c req-c615079b-2289-4e06-a546-c04c6ab16007 tempest-DeleteServersTestJSON-225385022 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-2742cca4-0c25-44d3-99b9-ae9eb647092e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35d77ca1-2ecf-4d92-a2bb-313d43b16dee', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:19:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-7001cabb-ad23-4155-a221-b1f1a6ef7f2c req-c615079b-2289-4e06-a546-c04c6ab16007 tempest-DeleteServersTestJSON-225385022 None] attachment_update completed successfully. Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Flow 'volume_create_manager' (d6a408b0-9496-42fd-b033-e10cdd8424fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a24cf-1235-4365-8c8c-042959114f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a24cf-1235-4365-8c8c-042959114f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1706041710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e5327c-0b5f-455d-908c-9c654e21a090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceace1d6f5ef4b5ea52c990391216f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:31Z,use_quota=True,user_id='b2c1eaaac4bc4daeb1b0057a009c55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1b559-8c11-4e89-bd1e-2de2b1403f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1b559-8c11-4e89-bd1e-2de2b1403f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c83151d-0b46-49fc-8f2e-e7d73a73c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c83151d-0b46-49fc-8f2e-e7d73a73c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e5327c-0b5f-455d-908c-9c654e21a090', 'volume_name': 'volume-92e5327c-0b5f-455d-908c-9c654e21a090', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d8234c-ce19-4e4e-bb87-96ff246d852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d8234c-ce19-4e4e-bb87-96ff246d852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aba72d-41b8-4ec5-b0c8-a98800288c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:31 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Volume 92e5327c-0b5f-455d-908c-9c654e21a090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e5327c-0b5f-455d-908c-9c654e21a090', 'volume_size': 1} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1706041710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e5327c-0b5f-455d-908c-9c654e21a090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceace1d6f5ef4b5ea52c990391216f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:31Z,use_quota=True,user_id='b2c1eaaac4bc4daeb1b0057a009c55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Creating volume 92e5327c-0b5f-455d-908c-9c654e21a090 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:19:31 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:19:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:31 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 1073741824 Sep 22 18:19:31 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:32 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 1073741824" returned: 0 in 0.793s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:32 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 Sep 22 18:19:32 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:32 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090" returned: 0 in 0.736s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aba72d-41b8-4ec5-b0c8-a98800288c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e5327c-0b5f-455d-908c-9c654e21a090', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a303a8a-2c59-41a2-a0b2-d3b94b5c9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:32 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Volume volume-92e5327c-0b5f-455d-908c-9c654e21a090 (92e5327c-0b5f-455d-908c-9c654e21a090): created successfully Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a303a8a-2c59-41a2-a0b2-d3b94b5c9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Flow 'volume_create_manager' (d6a408b0-9496-42fd-b033-e10cdd8424fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-93835c80-eafb-40b3-a524-67a6f289c1db tempest-ServersNegativeTestJSON-1676403290 None] Created volume successfully. Sep 22 18:19:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-bc6f96c1-3eea-4399-bcee-9e23ec2bb6ef req-6b4b579e-a21d-4db0-89f7-9a7f3fe60311 tempest-DeleteServersTestJSON-225385022 None] Terminate volume connection completed successfully. Sep 22 18:19:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-bc6f96c1-3eea-4399-bcee-9e23ec2bb6ef req-6b4b579e-a21d-4db0-89f7-9a7f3fe60311 tempest-DeleteServersTestJSON-225385022 None] Deleting attachment 35d77ca1-2ecf-4d92-a2bb-313d43b16dee. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Flow 'volume_create_manager' (654083d7-2814-4b4c-9f19-13d70b048b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5dc1b5-8b01-4001-9751-80a3b3a3318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "cinder-2742cca4-0c25-44d3-99b9-ae9eb647092e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5dc1b5-8b01-4001-9751-80a3b3a3318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-747205007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25460cd0-038c-4552-88a7-2a88e99fb1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceace1d6f5ef4b5ea52c990391216f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:35Z,use_quota=True,user_id='b2c1eaaac4bc4daeb1b0057a009c55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704a095-0d0a-4a8d-8dfd-4f0099bdf14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704a095-0d0a-4a8d-8dfd-4f0099bdf14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0406b037-2198-4bd8-a0a8-2bf461f6ef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0406b037-2198-4bd8-a0a8-2bf461f6ef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25460cd0-038c-4552-88a7-2a88e99fb1f1', 'volume_name': 'volume-25460cd0-038c-4552-88a7-2a88e99fb1f1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff0dd27-3e48-44a5-b710-c9c1b93e0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff0dd27-3e48-44a5-b710-c9c1b93e0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07728873-cfd6-4703-8094-c4532d4b1804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Volume 25460cd0-038c-4552-88a7-2a88e99fb1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25460cd0-038c-4552-88a7-2a88e99fb1f1', 'volume_size': 1} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-747205007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25460cd0-038c-4552-88a7-2a88e99fb1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceace1d6f5ef4b5ea52c990391216f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:35Z,use_quota=True,user_id='b2c1eaaac4bc4daeb1b0057a009c55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Creating volume 25460cd0-038c-4552-88a7-2a88e99fb1f1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:19:35 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "cinder-2742cca4-0c25-44d3-99b9-ae9eb647092e-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:35 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 1073741824 Sep 22 18:19:35 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "cinder-quobyte-2742cca4-0c25-44d3-99b9-ae9eb647092e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "cinder-quobyte-2742cca4-0c25-44d3-99b9-ae9eb647092e" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb4da5-cc97-48b8-8dca-8e8a021db475]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:19:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:35 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e Sep 22 18:19:35 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:36 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 1073741824" returned: 0 in 0.534s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:36 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e" returned: 0 in 0.445s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:36 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 Sep 22 18:19:36 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:36 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e Sep 22 18:19:36 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:36 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1" returned: 0 in 0.317s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07728873-cfd6-4703-8094-c4532d4b1804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25460cd0-038c-4552-88a7-2a88e99fb1f1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674032ec-ffbd-4ee5-9897-7f00c1513c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:36 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2742cca4-0c25-44d3-99b9-ae9eb647092e" returned: 0 in 0.340s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "cinder-quobyte-2742cca4-0c25-44d3-99b9-ae9eb647092e" released by "delete_volume" :: held 0.861s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Volume volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 (25460cd0-038c-4552-88a7-2a88e99fb1f1): created successfully Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674032ec-ffbd-4ee5-9897-7f00c1513c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Flow 'volume_create_manager' (654083d7-2814-4b4c-9f19-13d70b048b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-54df8010-c334-409d-830c-ace19809cf7b tempest-ServersNegativeTestJSON-1676403290 None] Created volume successfully. Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Created reservations ['988c7edb-27d9-43d5-a2b7-d9713f41b021', '889bbda5-98ee-4ed4-ac9a-8df168dd50a4', '7f008182-b442-45fc-9c77-bb3ce980664e', 'b0288fbd-b7db-457a-934e-c9978cf12618'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:36 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:19:36 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:36 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.255s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:36 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:19:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Deleted volume successfully. Sep 22 18:19:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0a5eb96-109e-43ac-bc80-d0fa1aa53f1d tempest-DeleteServersTestJSON-225385022 None] Lock "cinder-2742cca4-0c25-44d3-99b9-ae9eb647092e-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "cinder-25460cd0-038c-4552-88a7-2a88e99fb1f1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-25460cd0-038c-4552-88a7-2a88e99fb1f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "cinder-quobyte-25460cd0-038c-4552-88a7-2a88e99fb1f1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-quobyte-25460cd0-038c-4552-88a7-2a88e99fb1f1" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c16b89e-b447-4a71-8987-28390b78cd28]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:19:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:39 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 Sep 22 18:19:39 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:40 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1" returned: 0 in 0.407s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:40 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1 Sep 22 18:19:40 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:40 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-25460cd0-038c-4552-88a7-2a88e99fb1f1" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-quobyte-25460cd0-038c-4552-88a7-2a88e99fb1f1" released by "delete_volume" :: held 0.715s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Created reservations ['1589a31e-22d2-4fce-bdf6-dec3f1fa7baf', '3a945b3d-3e4e-415e-8f19-1d804290dcfd', 'c80427ae-bf11-4c55-b14c-be4a780756ac', '55f7ddbd-681b-4ca2-bd5e-535aeebb2cbc'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:40 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:19:40 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "cinder-92e5327c-0b5f-455d-908c-9c654e21a090-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:40 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-92e5327c-0b5f-455d-908c-9c654e21a090-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.335s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:19:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Deleted volume successfully. Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8e0f217c-797d-424b-908a-20de178f0218 tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-25460cd0-038c-4552-88a7-2a88e99fb1f1-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "cinder-quobyte-92e5327c-0b5f-455d-908c-9c654e21a090" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-quobyte-92e5327c-0b5f-455d-908c-9c654e21a090" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b239a26f-eb30-4c51-b6bb-61d83f534660]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:41 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 Sep 22 18:19:41 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:41 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090" returned: 0 in 0.368s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:41 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090 Sep 22 18:19:41 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:41 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-92e5327c-0b5f-455d-908c-9c654e21a090" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-quobyte-92e5327c-0b5f-455d-908c-9c654e21a090" released by "delete_volume" :: held 0.677s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Created reservations ['29b1dd1f-0ce9-4a3d-9dd3-4fca77b92632', 'b52b31f6-8a61-4270-b78d-c2a62277c3e1', '8165c46f-c87c-4646-a40e-1cfc4312dd23', '6538f534-fe36-4eb8-8714-a9e8ed9d791d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:41 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:19:41 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:42 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.410s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:42 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:19:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Deleted volume successfully. Sep 22 18:19:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32a7be81-1d9d-4182-b27d-e7b84a5602ee tempest-ServersNegativeTestJSON-1676403290 None] Lock "cinder-92e5327c-0b5f-455d-908c-9c654e21a090-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:19:47 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-9f1946a4-7e6a-4596-8389-e744dac76c17 req-4412ed76-a961-4ad6-a53d-c451719ba4ec tempest-ServerActionsTestOtherA-479923576 None] Terminate volume connection completed successfully. Sep 22 18:19:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-9f1946a4-7e6a-4596-8389-e744dac76c17 req-4412ed76-a961-4ad6-a53d-c451719ba4ec tempest-ServerActionsTestOtherA-479923576 None] Deleting attachment c0c256e7-807b-4eda-beab-8a149784fbc8. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:19:48 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:19:48 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:19:48 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.361s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 8 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:19:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:19:57 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=29,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:57 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=30,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Flow 'volume_create_manager' (552625b4-e69e-4137-b6ba-9bb05fcd3084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64efab9-4bdf-4d8e-85fa-8b168595db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64efab9-4bdf-4d8e-85fa-8b168595db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-566909340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08574d58-17a3-4b69-a10c-d25da684ea47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3024e4bf6e4fde9d502a84615097a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:59Z,use_quota=True,user_id='bc18f71d909e4278a159deadffdeb721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcb097f-7578-4952-883e-254d5e872809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcb097f-7578-4952-883e-254d5e872809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7507fa4e-dc7e-4c6e-b139-c732b73825f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:58 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7507fa4e-dc7e-4c6e-b139-c732b73825f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08574d58-17a3-4b69-a10c-d25da684ea47', 'volume_name': 'volume-08574d58-17a3-4b69-a10c-d25da684ea47', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd4168-dc19-4541-872f-496c07b888f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd4168-dc19-4541-872f-496c07b888f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269cd5fd-c2fb-4b11-86fa-5233734c3ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:19:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Volume 08574d58-17a3-4b69-a10c-d25da684ea47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08574d58-17a3-4b69-a10c-d25da684ea47', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Trying to clone 08574d58-17a3-4b69-a10c-d25da684ea47 from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:19:59 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Image download 20.69 MB at 20.69 MB/s Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4d625-fcd9-4ec7-9b2e-414c1176e59c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:19:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:00 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD Sep 22 18:20:00 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:00 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 is fetched for user bc18f71d909e4278a159deadffdeb721. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cca382a-a13b-437b-956b-a6c58d89c9b5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:00 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD Sep 22 18:20:00 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:00 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-566909340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08574d58-17a3-4b69-a10c-d25da684ea47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec3024e4bf6e4fde9d502a84615097a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:19:59Z,use_quota=True,user_id='bc18f71d909e4278a159deadffdeb721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Creating volume 08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:20:00 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:20:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:00 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1073741824 Sep 22 18:20:00 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:01 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1073741824" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:01 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 Sep 22 18:20:01 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:01 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Attempting download of 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 08574d58-17a3-4b69-a10c-d25da684ea47. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5bb152-253a-45f6-a407-7886e4c109b3]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:20:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:01 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9 Sep 22 18:20:01 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:02 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:02 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9 Sep 22 18:20:02 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:02 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9" returned: 1 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_g48qmdu9' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddafb538-b225-40e0-9923-b7a9f6975267]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:02 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD Sep 22 18:20:02 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:02 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:20:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:02 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 Sep 22 18:20:02 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:05 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47" returned: 0 in 2.769s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:05 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_ojdzwg4bdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:20:05 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Converted 112.00 MB image at 40.43 MB/s Sep 22 18:20:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:05 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1G Sep 22 18:20:05 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:06 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 1G" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Downloaded image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 08574d58-17a3-4b69-a10c-d25da684ea47 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 for user bc18f71d909e4278a159deadffdeb721 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Marking volume 08574d58-17a3-4b69-a10c-d25da684ea47 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Copying metadata from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 to 08574d58-17a3-4b69-a10c-d25da684ea47. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Creating volume glance metadata for volume 08574d58-17a3-4b69-a10c-d25da684ea47 backed by image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269cd5fd-c2fb-4b11-86fa-5233734c3ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08574d58-17a3-4b69-a10c-d25da684ea47', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17937d72-4514-4de4-ad39-b1a2a6e52c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Volume volume-08574d58-17a3-4b69-a10c-d25da684ea47 (08574d58-17a3-4b69-a10c-d25da684ea47): created successfully Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17937d72-4514-4de4-ad39-b1a2a6e52c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Flow 'volume_create_manager' (552625b4-e69e-4137-b6ba-9bb05fcd3084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:20:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-866233f0-3520-441d-97c0-3af7dcae731b tempest-ServerActionsTestOtherA-479923576 None] Created volume successfully. Sep 22 18:20:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b607f83f-85ba-4803-8c80-21cbbe0c654c req-c6a28c35-ef2c-4c04-aa7c-2dc1dbec6909 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b607f83f-85ba-4803-8c80-21cbbe0c654c req-c6a28c35-ef2c-4c04-aa7c-2dc1dbec6909 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b607f83f-85ba-4803-8c80-21cbbe0c654c req-c6a28c35-ef2c-4c04-aa7c-2dc1dbec6909 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-b607f83f-85ba-4803-8c80-21cbbe0c654c req-c6a28c35-ef2c-4c04-aa7c-2dc1dbec6909 tempest-ServerActionsTestOtherA-479923576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-08574d58-17a3-4b69-a10c-d25da684ea47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60aeac7c-76c9-4968-9c1a-b402bb434df9', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:20:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-b607f83f-85ba-4803-8c80-21cbbe0c654c req-c6a28c35-ef2c-4c04-aa7c-2dc1dbec6909 tempest-ServerActionsTestOtherA-479923576 None] attachment_update completed successfully. Sep 22 18:20:24 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=7 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:20:24 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Flow 'volume_create_manager' (a66b6c78-a446-4c29-b0fe-eb31347b4a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2f4298-2fb1-4492-8ca1-46ac9fbc71d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2f4298-2fb1-4492-8ca1-46ac9fbc71d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-843695780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36d3631-30f0-439b-bce3-81be142c603d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c260e9ac3567461a97f478f2d83412af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:20:42Z,use_quota=True,user_id='9ff6761b06b14baa9cbc0a4e38db11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971ff202-5d1e-44b5-bc3e-d0a258cfd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971ff202-5d1e-44b5-bc3e-d0a258cfd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9755850f-9bdb-4611-9cec-b11542634332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9755850f-9bdb-4611-9cec-b11542634332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36d3631-30f0-439b-bce3-81be142c603d', 'volume_name': 'volume-e36d3631-30f0-439b-bce3-81be142c603d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353d6c3c-d023-413d-83c6-a22bcbd2768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353d6c3c-d023-413d-83c6-a22bcbd2768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fee816-15a4-4129-b1d6-321ed2dd40f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:42 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Volume e36d3631-30f0-439b-bce3-81be142c603d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36d3631-30f0-439b-bce3-81be142c603d', 'volume_size': 1} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-843695780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36d3631-30f0-439b-bce3-81be142c603d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c260e9ac3567461a97f478f2d83412af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:20:42Z,use_quota=True,user_id='9ff6761b06b14baa9cbc0a4e38db11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Creating volume e36d3631-30f0-439b-bce3-81be142c603d {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:20:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:20:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:20:43 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:20:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:43 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d 1073741824 Sep 22 18:20:43 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:44 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d 1073741824" returned: 0 in 1.108s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:44 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d Sep 22 18:20:44 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:45 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d" returned: 0 in 1.001s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fee816-15a4-4129-b1d6-321ed2dd40f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36d3631-30f0-439b-bce3-81be142c603d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c9bcb1-f0d8-4960-8e8c-d15766925e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:45 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Volume volume-e36d3631-30f0-439b-bce3-81be142c603d (e36d3631-30f0-439b-bce3-81be142c603d): created successfully Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c9bcb1-f0d8-4960-8e8c-d15766925e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Flow 'volume_create_manager' (a66b6c78-a446-4c29-b0fe-eb31347b4a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:20:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ce96613d-828e-4c5d-9d82-d10a4016b8a8 tempest-AttachVolumeShelveTestJSON-1923373795 None] Created volume successfully. Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:48 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:20:48 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:49 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.617s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:49 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:20:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-0ebefb1d-cf05-4779-a40f-1f203ad57131 tempest-ServerActionsTestOtherA-479923576 None] Terminate volume connection completed successfully. Sep 22 18:20:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-0ebefb1d-cf05-4779-a40f-1f203ad57131 tempest-ServerActionsTestOtherA-479923576 None] Deleting attachment 60aeac7c-76c9-4968-9c1a-b402bb434df9. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Flow 'volume_create_manager' (0e7993a9-67e2-4bf5-a6f2-7672efde4acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8430f9c5-4e37-4422-bcfa-bc5bb1871114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8430f9c5-4e37-4422-bcfa-bc5bb1871114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-188345383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6b58b4-750e-4d37-a810-bfc9db50ec97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a5a6b4d7da4109aff2c003457a626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:20:52Z,use_quota=True,user_id='78af264ab76143659d9484ee6c68c93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522488bc-eeb5-42a7-b644-d4e24f69de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522488bc-eeb5-42a7-b644-d4e24f69de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411f938f-db68-4d3e-bfc9-502bd01bae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411f938f-db68-4d3e-bfc9-502bd01bae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6b58b4-750e-4d37-a810-bfc9db50ec97', 'volume_name': 'volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf756c5-5241-4eeb-9b12-9d0b3341aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf756c5-5241-4eeb-9b12-9d0b3341aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda12ea9-5128-4a61-863d-c0a62ad226ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Volume cd6b58b4-750e-4d37-a810-bfc9db50ec97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97', 'volume_size': 1} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-188345383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6b58b4-750e-4d37-a810-bfc9db50ec97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a5a6b4d7da4109aff2c003457a626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:20:52Z,use_quota=True,user_id='78af264ab76143659d9484ee6c68c93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Creating volume cd6b58b4-750e-4d37-a810-bfc9db50ec97 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:20:51 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:20:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:51 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 1073741824 Sep 22 18:20:51 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:52 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 1073741824" returned: 0 in 0.859s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:20:52 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 Sep 22 18:20:52 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:20:53 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97" returned: 0 in 0.789s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda12ea9-5128-4a61-863d-c0a62ad226ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec73020-6916-42fe-b7c7-bc18b4a04487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:20:53 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Volume volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 (cd6b58b4-750e-4d37-a810-bfc9db50ec97): created successfully Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec73020-6916-42fe-b7c7-bc18b4a04487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:20:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Flow 'volume_create_manager' (0e7993a9-67e2-4bf5-a6f2-7672efde4acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:20:53 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5b5d595b-5446-49eb-ae9b-dc53bbedba51 tempest-ServerRescueNegativeTestJSON-418979326 None] Created volume successfully. Sep 22 18:20:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-cf67fc5f-38d2-4ca0-8ac6-4a4468315b1e tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:20:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-cf67fc5f-38d2-4ca0-8ac6-4a4468315b1e tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:20:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-cf67fc5f-38d2-4ca0-8ac6-4a4468315b1e tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:20:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-cf67fc5f-38d2-4ca0-8ac6-4a4468315b1e tempest-ServerActionsTestOtherA-479923576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-08574d58-17a3-4b69-a10c-d25da684ea47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '435531af-b314-40e8-ad2d-06d73ff6543f', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:20:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-438ffa96-1c82-4d42-a807-e0fe08de7ef1 req-cf67fc5f-38d2-4ca0-8ac6-4a4468315b1e tempest-ServerActionsTestOtherA-479923576 None] attachment_update completed successfully. Sep 22 18:21:04 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=9,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:21:04 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=15,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:21:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-45b3d242-9b2c-4444-a68d-d28cffe1d65c req-47bc63b5-0cf4-456c-90cd-3d81626d63f5 tempest-AttachVolumeShelveTestJSON-1923373795 None] No connector for attachment 53b65803-9a47-4c79-a2e9-680df77401ef; skipping storage backend terminate_connection call. {{(pid=86046) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 22 18:21:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-45b3d242-9b2c-4444-a68d-d28cffe1d65c req-47bc63b5-0cf4-456c-90cd-3d81626d63f5 tempest-AttachVolumeShelveTestJSON-1923373795 None] Deleting attachment 53b65803-9a47-4c79-a2e9-680df77401ef. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:21:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Acquiring lock "cinder-cd6b58b4-750e-4d37-a810-bfc9db50ec97-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "cinder-cd6b58b4-750e-4d37-a810-bfc9db50ec97-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Acquiring lock "cinder-quobyte-cd6b58b4-750e-4d37-a810-bfc9db50ec97" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "cinder-quobyte-cd6b58b4-750e-4d37-a810-bfc9db50ec97" acquired by "delete_volume" :: waited 0.044s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f6796c-3163-4163-bc73-090ef960e0d4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:11 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 Sep 22 18:21:11 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:11 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97" returned: 0 in 0.497s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:11 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97 Sep 22 18:21:11 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:11 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cd6b58b4-750e-4d37-a810-bfc9db50ec97" returned: 0 in 0.325s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "cinder-quobyte-cd6b58b4-750e-4d37-a810-bfc9db50ec97" released by "delete_volume" :: held 0.922s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Created reservations ['4030edce-8e75-49d5-9b31-1f069ad082ae', 'f49c019d-4d4a-44e0-bbd6-90f4d474a60d', '931c98f3-07ca-4b26-aa5f-21f11a186e11', 'ab8d5fbb-9c2d-431b-ad1d-aa6d9d68e25b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:12 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:12 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:12 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.411s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Deleted volume successfully. Sep 22 18:21:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c6b0c3e-bdeb-4af4-a2f2-a0d5a3ed8b65 tempest-ServerRescueNegativeTestJSON-418979326 None] Lock "cinder-cd6b58b4-750e-4d37-a810-bfc9db50ec97-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (0debb1b6-710f-4419-ad0d-7fbc2afab089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37a0421-e857-4df4-a8ae-10dc129e4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37a0421-e857-4df4-a8ae-10dc129e4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1519017314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94488d35-8cba-48f3-aed9-b9cacf3a058c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:21:14Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e83052f-7067-410f-ae73-c85c7cdefd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e83052f-7067-410f-ae73-c85c7cdefd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7b7bc5-3f19-4e6d-a464-530618721822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7b7bc5-3f19-4e6d-a464-530618721822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94488d35-8cba-48f3-aed9-b9cacf3a058c', 'volume_name': 'volume-94488d35-8cba-48f3-aed9-b9cacf3a058c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f50a10-056c-4c93-810f-6ce32db38a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f50a10-056c-4c93-810f-6ce32db38a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b4133a-1327-4999-92eb-7d77e7d3b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:13 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Volume 94488d35-8cba-48f3-aed9-b9cacf3a058c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94488d35-8cba-48f3-aed9-b9cacf3a058c', 'volume_size': 1} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1519017314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94488d35-8cba-48f3-aed9-b9cacf3a058c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:21:14Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Creating volume 94488d35-8cba-48f3-aed9-b9cacf3a058c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:21:13 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:21:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:13 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c 1073741824 Sep 22 18:21:13 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:15 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c 1073741824" returned: 0 in 1.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:15 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c Sep 22 18:21:15 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:16 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c" returned: 0 in 0.829s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b4133a-1327-4999-92eb-7d77e7d3b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94488d35-8cba-48f3-aed9-b9cacf3a058c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0f81b2-1d03-470e-80d3-af5cfa777095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Volume volume-94488d35-8cba-48f3-aed9-b9cacf3a058c (94488d35-8cba-48f3-aed9-b9cacf3a058c): created successfully Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0f81b2-1d03-470e-80d3-af5cfa777095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (0debb1b6-710f-4419-ad0d-7fbc2afab089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:21:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a89187c7-c44a-485f-bedb-f82ba1e6aa36 tempest-AttachVolumeNegativeTest-98167208 None] Created volume successfully. Sep 22 18:21:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b45e983f-5f01-4062-82e4-b3afd4ed3256 req-32efb9e4-9f50-4549-94c4-e51fbc203cbf tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b45e983f-5f01-4062-82e4-b3afd4ed3256 req-32efb9e4-9f50-4549-94c4-e51fbc203cbf tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-b45e983f-5f01-4062-82e4-b3afd4ed3256 req-32efb9e4-9f50-4549-94c4-e51fbc203cbf tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:18 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-b45e983f-5f01-4062-82e4-b3afd4ed3256 req-32efb9e4-9f50-4549-94c4-e51fbc203cbf tempest-AttachVolumeNegativeTest-98167208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-94488d35-8cba-48f3-aed9-b9cacf3a058c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0e628b7-ca8e-415c-9cc8-89258082172d', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:21:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-b45e983f-5f01-4062-82e4-b3afd4ed3256 req-32efb9e4-9f50-4549-94c4-e51fbc203cbf tempest-AttachVolumeNegativeTest-98167208 None] attachment_update completed successfully. Sep 22 18:21:28 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:21:28 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Flow 'volume_create_manager' (f6cfb54f-1feb-42e3-b307-d00853510428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062c0367-3dcd-4e3d-af71-04ed82b37bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062c0367-3dcd-4e3d-af71-04ed82b37bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-841382258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d997c4d-728f-48b4-bc59-9345f76e3750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96627e5be02b472e9e6859bfcf6d0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:21:35Z,use_quota=True,user_id='7de4fd61955446a1a016d1dd242ab87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05805d2-f25c-47a9-96e6-879edc040e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05805d2-f25c-47a9-96e6-879edc040e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3f0970-c3b9-4209-ab48-854fb7927b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3f0970-c3b9-4209-ab48-854fb7927b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d997c4d-728f-48b4-bc59-9345f76e3750', 'volume_name': 'volume-0d997c4d-728f-48b4-bc59-9345f76e3750', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efee2f67-7fe5-4a02-a0d2-2912ab74abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efee2f67-7fe5-4a02-a0d2-2912ab74abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca679fd-8383-4d33-814d-c999618307b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Volume 0d997c4d-728f-48b4-bc59-9345f76e3750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d997c4d-728f-48b4-bc59-9345f76e3750', 'volume_size': 1} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-841382258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d997c4d-728f-48b4-bc59-9345f76e3750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96627e5be02b472e9e6859bfcf6d0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:21:35Z,use_quota=True,user_id='7de4fd61955446a1a016d1dd242ab87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Creating volume 0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:21:35 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:21:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:35 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 1073741824 Sep 22 18:21:35 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:36 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 1073741824" returned: 0 in 0.709s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:36 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 Sep 22 18:21:36 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:36 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750" returned: 0 in 0.336s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca679fd-8383-4d33-814d-c999618307b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d997c4d-728f-48b4-bc59-9345f76e3750', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386a71b6-ff39-4746-a1ac-517b213d4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:21:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Volume volume-0d997c4d-728f-48b4-bc59-9345f76e3750 (0d997c4d-728f-48b4-bc59-9345f76e3750): created successfully Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386a71b6-ff39-4746-a1ac-517b213d4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:21:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Flow 'volume_create_manager' (f6cfb54f-1feb-42e3-b307-d00853510428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:21:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-2c55ca6e-78d8-42b7-ac46-51479620ad51 req-15bc01d9-7b44-40fc-b4c0-759bbc3da468 tempest-VolumesSnapshotsTestJSON-647198921 None] Created volume successfully. Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Creating offline snapshot 47cb9698-3428-4ee7-80b8-dac739a33692 of volume 0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4e54fb-494b-43bf-90ab-2e6ad4e5ecc7]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:38 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 Sep 22 18:21:38 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:38 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750" returned: 0 in 0.616s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:38 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 1G Sep 22 18:21:38 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:39 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 1G" returned: 0 in 0.479s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d997c4d-728f-48b4-bc59-9345f76e3750 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:39 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d997c4d-728f-48b4-bc59-9345f76e3750 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 Sep 22 18:21:39 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:39 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d997c4d-728f-48b4-bc59-9345f76e3750 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692" returned: 0 in 0.424s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 is being set with open permissions: ugo+rw Sep 22 18:21:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:39 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 Sep 22 18:21:39 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:40 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692" returned: 0 in 0.291s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:40 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info Sep 22 18:21:40 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:40 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info" returned: 0 in 0.309s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:40 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info is being set with open permissions: ugo+rw Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:40 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info Sep 22 18:21:40 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:40 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.info" returned: 0 in 0.274s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-12a94d3e-70f2-443b-a2f3-49284cdbf402 req-bcb56c87-618d-425a-b255-26c6a49f9d8a tempest-VolumesSnapshotsTestJSON-647198921 None] Create snapshot completed successfully Sep 22 18:21:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "cinder-47cb9698-3428-4ee7-80b8-dac739a33692-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-47cb9698-3428-4ee7-80b8-dac739a33692-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "cinder-quobyte-47cb9698-3428-4ee7-80b8-dac739a33692" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-47cb9698-3428-4ee7-80b8-dac739a33692" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Deleting offline snapshot 47cb9698-3428-4ee7-80b8-dac739a33692 of volume 0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] snapshot_file for this snap is: volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b167d91-8124-4a82-b924-ef06776e8cc4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:42 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 Sep 22 18:21:42 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:42 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692" returned: 0 in 0.404s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d997c4d-728f-48b4-bc59-9345f76e3750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[37820f08-e9ef-4801-a5e8-6b47fa7a9244]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:42 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 Sep 22 18:21:42 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:42 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:42 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 Sep 22 18:21:42 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:43 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692" returned: 0 in 0.348s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:43 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692 Sep 22 18:21:43 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:43 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750.47cb9698-3428-4ee7-80b8-dac739a33692" returned: 0 in 0.286s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-47cb9698-3428-4ee7-80b8-dac739a33692" released by "_delete_snapshot" :: held 1.537s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" released by "delete_snapshot" :: held 1.562s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:43 devstack cinder-volume[86046]: WARNING cinder.quota [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG cinder.quota [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Created reservations ['c80144a8-ac1d-4736-b4b0-76bbe62d99c4', '693ba5a8-a466-4bb1-baad-513675f2e0ed', '3506c228-e79f-4dc4-852e-3c52d659f9e9', 'c0f3530e-0adc-425e-8864-f1c552fcf241'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Delete snapshot completed successfully. Sep 22 18:21:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7471c7a2-a33b-4612-97cb-1dd54cbe401b req-51edc7f4-6384-4810-8cf2-cb9e76dd0d3c tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-47cb9698-3428-4ee7-80b8-dac739a33692-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "cinder-0d997c4d-728f-48b4-bc59-9345f76e3750-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-0d997c4d-728f-48b4-bc59-9345f76e3750-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0416ea9e-448f-4263-b931-1eed4fbdac23]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:44 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 Sep 22 18:21:44 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:44 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750" returned: 0 in 0.386s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:44 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750 Sep 22 18:21:44 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:44 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0d997c4d-728f-48b4-bc59-9345f76e3750" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-quobyte-0d997c4d-728f-48b4-bc59-9345f76e3750" released by "delete_volume" :: held 0.711s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.quota [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Created reservations ['0e7d5a4b-756e-49d7-846f-de7b6b9636d8', '592c4037-1d19-446f-84dd-3938337336ce', '04b1e746-5783-4edc-8f4c-1f4ef502af8b', 'd5add34f-7a1f-4521-b898-6d60c38ccc90'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:45 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:45 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:45 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.manager [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Deleted volume successfully. Sep 22 18:21:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-e36f2e07-fd56-4fa9-81cc-c4db4dcde0d6 req-18812524-64e0-4d2d-b843-39471db9d7b2 tempest-VolumesSnapshotsTestJSON-647198921 None] Lock "cinder-0d997c4d-728f-48b4-bc59-9345f76e3750-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8f179e61-f501-4a61-990b-bea48456c726 req-8c2ec5b4-993d-4103-ae81-03678f2d6d7d tempest-ServerActionsTestOtherA-479923576 None] Terminate volume connection completed successfully. Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-8f179e61-f501-4a61-990b-bea48456c726 req-8c2ec5b4-993d-4103-ae81-03678f2d6d7d tempest-ServerActionsTestOtherA-479923576 None] Deleting attachment 435531af-b314-40e8-ad2d-06d73ff6543f. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "cinder-08574d58-17a3-4b69-a10c-d25da684ea47-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-08574d58-17a3-4b69-a10c-d25da684ea47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "cinder-quobyte-08574d58-17a3-4b69-a10c-d25da684ea47" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-quobyte-08574d58-17a3-4b69-a10c-d25da684ea47" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f400f1-5048-464b-9f6b-dd89479fee8f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:48 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:48 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:48 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 Sep 22 18:21:48 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:48 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.437s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:21:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:21:49 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47" returned: 0 in 0.795s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:49 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47 Sep 22 18:21:49 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:49 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-08574d58-17a3-4b69-a10c-d25da684ea47" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-quobyte-08574d58-17a3-4b69-a10c-d25da684ea47" released by "delete_volume" :: held 1.254s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG cinder.quota [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Created reservations ['44748ff0-4583-49f8-bcc8-07a33c8df8c8', '9f95475b-2f89-4734-ad5e-2a40c6b0501d', '63e556b1-8e77-4989-a36d-e961614840d3', '250e5518-8817-4375-bfdc-c9e5f3ecec71'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:49 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:49 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:50 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.585s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.manager [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Deleted volume successfully. Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-8f179e61-f501-4a61-990b-bea48456c726 req-070c18b6-0dd7-4e23-aa63-8793e3190adf tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-08574d58-17a3-4b69-a10c-d25da684ea47-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "cinder-609c79c2-03f7-43b6-bf93-6439d7b7623e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-609c79c2-03f7-43b6-bf93-6439d7b7623e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "cinder-quobyte-609c79c2-03f7-43b6-bf93-6439d7b7623e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-quobyte-609c79c2-03f7-43b6-bf93-6439d7b7623e" acquired by "delete_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2aa3b-9a1e-4ec1-bbb0-a80883a1882f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:51 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e Sep 22 18:21:51 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:51 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e" returned: 0 in 0.547s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:51 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e Sep 22 18:21:51 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:51 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-609c79c2-03f7-43b6-bf93-6439d7b7623e" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-quobyte-609c79c2-03f7-43b6-bf93-6439d7b7623e" released by "delete_volume" :: held 0.958s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Created reservations ['ecff0b0e-ed86-415b-b125-9a875199f902', '1629fb44-1ed8-408a-a39e-5aa75cb7a4c8', '3cda4032-8aff-4f77-8559-891f75e9406d', 'f315675a-539c-48f7-8760-78d28bd571e7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:52 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:52 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:52 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Deleted volume successfully. Sep 22 18:21:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b15aa081-9afe-46c2-9f98-4ef4aba5d600 tempest-ServerActionsTestOtherA-479923576 None] Lock "cinder-609c79c2-03f7-43b6-bf93-6439d7b7623e-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Acquiring lock "cinder-e36d3631-30f0-439b-bce3-81be142c603d-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "cinder-e36d3631-30f0-439b-bce3-81be142c603d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Acquiring lock "cinder-quobyte-e36d3631-30f0-439b-bce3-81be142c603d" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "cinder-quobyte-e36d3631-30f0-439b-bce3-81be142c603d" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09e907c-9748-4d1f-8d71-26ff36bd232c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:55 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d Sep 22 18:21:55 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:55 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:55 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d Sep 22 18:21:55 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:56 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e36d3631-30f0-439b-bce3-81be142c603d" returned: 0 in 0.278s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "cinder-quobyte-e36d3631-30f0-439b-bce3-81be142c603d" released by "delete_volume" :: held 0.706s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Created reservations ['aac9207f-8cab-40ce-8fa8-426aa6926391', 'cbf8b53a-1697-49c2-90e9-569a6eec18b4', '0b0d003b-1186-435f-a46d-7de041b0f74b', '386b1ee5-d42a-4e7e-8edd-ea3e1911e735'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:21:56 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:21:56 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:21:56 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.277s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:21:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Deleted volume successfully. Sep 22 18:21:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-49a4dc09-7424-4a0e-9928-ea4e2b69e778 tempest-AttachVolumeShelveTestJSON-1923373795 None] Lock "cinder-e36d3631-30f0-439b-bce3-81be142c603d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:21:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4928fef8-ccfa-47d6-bf9b-343adf730dbb tempest-GroupsTest-617271241 None] Group tempest-Group1-1369690348: creating Sep 22 18:21:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4928fef8-ccfa-47d6-bf9b-343adf730dbb tempest-GroupsTest-617271241 None] Group tempest-Group1-1369690348: created successfully Sep 22 18:21:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4928fef8-ccfa-47d6-bf9b-343adf730dbb tempest-GroupsTest-617271241 None] Create group completed successfully. Sep 22 18:21:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6252b21e-1ded-4ea7-830b-7e4f29ed3e30 tempest-GroupsTest-617271241 None] Group tempest-Group2-1615593276: creating Sep 22 18:21:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6252b21e-1ded-4ea7-830b-7e4f29ed3e30 tempest-GroupsTest-617271241 None] Group tempest-Group2-1615593276: created successfully Sep 22 18:21:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6252b21e-1ded-4ea7-830b-7e4f29ed3e30 tempest-GroupsTest-617271241 None] Create group completed successfully. Sep 22 18:22:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (9b90ad25-3fd2-4a58-a9be-d70ae16d19e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1437c9-842f-43bc-922b-257ce1856b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1437c9-842f-43bc-922b-257ce1856b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615727560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adfc3c8d-1ea6-419a-bed6-dc3c82db053d,host='devstack@QuobyteHD#QuobyteHD',id=bc946455-cd57-4976-b3cf-0deeb056588c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:01Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af4d57-8b90-46b4-8cfd-56bf8891b611),volume_type_id=84af4d57-8b90-46b4-8cfd-56bf8891b611)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dbf4c6-fe27-465c-9c5d-28e7c2f463c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dbf4c6-fe27-465c-9c5d-28e7c2f463c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2b869c-702e-4c4d-b8a8-255425350720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2b869c-702e-4c4d-b8a8-255425350720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc946455-cd57-4976-b3cf-0deeb056588c', 'volume_name': 'volume-bc946455-cd57-4976-b3cf-0deeb056588c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea85b44-0093-4896-a37d-61d6f54c6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea85b44-0093-4896-a37d-61d6f54c6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463ee439-1655-4e5b-b9fd-4425544ede45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Volume bc946455-cd57-4976-b3cf-0deeb056588c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc946455-cd57-4976-b3cf-0deeb056588c', 'volume_size': 1} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=adfc3c8d-1ea6-419a-bed6-dc3c82db053d,created_at=2026-09-22T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615727560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adfc3c8d-1ea6-419a-bed6-dc3c82db053d,host='devstack@QuobyteHD#QuobyteHD',id=bc946455-cd57-4976-b3cf-0deeb056588c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:01Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84af4d57-8b90-46b4-8cfd-56bf8891b611),volume_type_id=84af4d57-8b90-46b4-8cfd-56bf8891b611)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Creating volume bc946455-cd57-4976-b3cf-0deeb056588c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:01 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:01 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c 1073741824 Sep 22 18:22:01 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:01 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c 1073741824" returned: 0 in 0.689s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:01 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c Sep 22 18:22:01 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:02 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463ee439-1655-4e5b-b9fd-4425544ede45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc946455-cd57-4976-b3cf-0deeb056588c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301b51e7-2db4-46fd-a8e6-4ea20084c208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Volume volume-bc946455-cd57-4976-b3cf-0deeb056588c (bc946455-cd57-4976-b3cf-0deeb056588c): created successfully Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301b51e7-2db4-46fd-a8e6-4ea20084c208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (9b90ad25-3fd2-4a58-a9be-d70ae16d19e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5cfbd1cf-ef30-41d9-adb8-eba40e66c585 tempest-GroupsTest-617271241 None] Created volume successfully. Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Acquiring lock "cinder-quobyte-bc946455-cd57-4976-b3cf-0deeb056588c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-bc946455-cd57-4976-b3cf-0deeb056588c" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8667c7d3-6ddb-4d5c-9371-93cb9af373ec]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:04 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c Sep 22 18:22:04 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:04 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c" returned: 0 in 0.422s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:04 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c Sep 22 18:22:04 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:04 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bc946455-cd57-4976-b3cf-0deeb056588c" returned: 0 in 0.307s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-bc946455-cd57-4976-b3cf-0deeb056588c" released by "delete_volume" :: held 0.787s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Created reservations ['e14ae246-8fc6-430f-bdd2-fb90db2a4084'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:05 devstack cinder-volume[86046]: WARNING cinder.quota [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1158475519 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1158475519, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:22:05 devstack cinder-volume[86046]: WARNING cinder.quota [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1158475519 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1158475519, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Created reservations ['429f5046-ec3e-418d-83ad-8a1465ae685f', '62c1ede7-a38f-46eb-9ac2-54773f8cebe1', 'e6e7e01f-ae8c-497a-8fd2-db1f8e4040e1', '9789c611-6acc-40eb-a797-f870a76b5271'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:05 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:05 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:05 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7cffa4f9-60bc-44d2-94e2-db8dac847d80 tempest-GroupsTest-617271241 None] Delete group completed successfully. Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Created reservations ['c1a8c680-18db-47de-8edf-c10131ba807a'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:05 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:05 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:06 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:06 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d6794c8b-4d77-41b8-bf4c-75811067da76 tempest-GroupsTest-617271241 None] Delete group completed successfully. Sep 22 18:22:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dee38d7b-73c2-4a83-97d5-ef3b4a71c777 tempest-GroupsTest-617271241 None] Group tempest-GroupsTest-Group-926074554: creating Sep 22 18:22:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dee38d7b-73c2-4a83-97d5-ef3b4a71c777 tempest-GroupsTest-617271241 None] Group tempest-GroupsTest-Group-926074554: created successfully Sep 22 18:22:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dee38d7b-73c2-4a83-97d5-ef3b4a71c777 tempest-GroupsTest-617271241 None] Create group completed successfully. Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (44a8e0af-f5e8-4b21-b81a-07727926e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8c9250-3cdf-4369-b93b-461fed8dc5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8c9250-3cdf-4369-b93b-461fed8dc5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262647586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d395b152-3a09-4070-aad9-a8c65b841660,host='devstack@QuobyteHD#QuobyteHD',id=3e544dbf-4209-4d74-8436-2e73ce927305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:09Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b7db575-15fe-4231-84c1-55a27b5b2480),volume_type_id=8b7db575-15fe-4231-84c1-55a27b5b2480)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7b1ab-e401-48be-a84c-d601c8e83900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7b1ab-e401-48be-a84c-d601c8e83900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174f41c-601b-4ca7-9dc8-c9c588c02377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174f41c-601b-4ca7-9dc8-c9c588c02377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e544dbf-4209-4d74-8436-2e73ce927305', 'volume_name': 'volume-3e544dbf-4209-4d74-8436-2e73ce927305', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cca41a-4320-49d4-9148-0b769e2f605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cca41a-4320-49d4-9148-0b769e2f605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b92b649-e58a-4922-ab09-7bacf1512dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Volume 3e544dbf-4209-4d74-8436-2e73ce927305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e544dbf-4209-4d74-8436-2e73ce927305', 'volume_size': 1} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d395b152-3a09-4070-aad9-a8c65b841660,created_at=2026-09-22T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262647586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d395b152-3a09-4070-aad9-a8c65b841660,host='devstack@QuobyteHD#QuobyteHD',id=3e544dbf-4209-4d74-8436-2e73ce927305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:09Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b7db575-15fe-4231-84c1-55a27b5b2480),volume_type_id=8b7db575-15fe-4231-84c1-55a27b5b2480)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Creating volume 3e544dbf-4209-4d74-8436-2e73ce927305 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:09 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:09 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 1073741824 Sep 22 18:22:09 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:09 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 1073741824" returned: 0 in 0.540s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:09 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 Sep 22 18:22:09 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:10 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305" returned: 0 in 0.274s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b92b649-e58a-4922-ab09-7bacf1512dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e544dbf-4209-4d74-8436-2e73ce927305', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a1887b-27ad-4d3e-bd9f-519b3ea126ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Volume volume-3e544dbf-4209-4d74-8436-2e73ce927305 (3e544dbf-4209-4d74-8436-2e73ce927305): created successfully Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a1887b-27ad-4d3e-bd9f-519b3ea126ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (44a8e0af-f5e8-4b21-b81a-07727926e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-42ca8695-7c66-4cf4-922b-7a37640e761c tempest-GroupsTest-617271241 None] Created volume successfully. Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (4d5b6e4b-15c1-43b4-a3a0-48a4101ee01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67daa857-ba7c-4219-8d0b-50effdb481f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67daa857-ba7c-4219-8d0b-50effdb481f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878971362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d395b152-3a09-4070-aad9-a8c65b841660,host='devstack@QuobyteHD#QuobyteHD',id=0ec52c53-fdc1-475d-8ee7-3956ba720d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:11Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b7db575-15fe-4231-84c1-55a27b5b2480),volume_type_id=8b7db575-15fe-4231-84c1-55a27b5b2480)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2475708-3fef-409a-bf06-35be686f87e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2475708-3fef-409a-bf06-35be686f87e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad1694-d1aa-4a5d-b287-e380c7e5b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad1694-d1aa-4a5d-b287-e380c7e5b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec52c53-fdc1-475d-8ee7-3956ba720d4f', 'volume_name': 'volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1355cde-0b4f-4b65-afce-65f26e6e0c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1355cde-0b4f-4b65-afce-65f26e6e0c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d43b81a-3694-4d6e-b4df-d473962005e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Volume 0ec52c53-fdc1-475d-8ee7-3956ba720d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f', 'volume_size': 1} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d395b152-3a09-4070-aad9-a8c65b841660,created_at=2026-09-22T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878971362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d395b152-3a09-4070-aad9-a8c65b841660,host='devstack@QuobyteHD#QuobyteHD',id=0ec52c53-fdc1-475d-8ee7-3956ba720d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c48ae5bfd24dd4bcee2845a99ab803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:11Z,use_quota=True,user_id='cfcc452bbdef4897947ffa932ff524f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b7db575-15fe-4231-84c1-55a27b5b2480),volume_type_id=8b7db575-15fe-4231-84c1-55a27b5b2480)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Creating volume 0ec52c53-fdc1-475d-8ee7-3956ba720d4f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:11 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:11 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f 1073741824 Sep 22 18:22:11 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:11 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f 1073741824" returned: 0 in 0.518s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:11 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f Sep 22 18:22:11 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:12 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d43b81a-3694-4d6e-b4df-d473962005e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05960eb-53e7-490d-842d-4315b023c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Volume volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f (0ec52c53-fdc1-475d-8ee7-3956ba720d4f): created successfully Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05960eb-53e7-490d-842d-4315b023c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Flow 'volume_create_manager' (4d5b6e4b-15c1-43b4-a3a0-48a4101ee01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5d86d311-d084-4de7-8085-35a863c69c16 tempest-GroupsTest-617271241 None] Created volume successfully. Sep 22 18:22:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b6118ae6-16da-4525-9699-37586b2fc346 tempest-GroupsTest-617271241 None] Update group completed successfully. Sep 22 18:22:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-61258ab9-d59f-4106-962b-362f57b815af tempest-GroupsTest-617271241 None] Update group completed successfully. Sep 22 18:22:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Acquiring lock "cinder-quobyte-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e1a83-3718-47fd-9794-2f50c061335d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:16 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f Sep 22 18:22:16 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:16 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" returned: 0 in 0.457s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:16 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f Sep 22 18:22:16 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:16 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" returned: 0 in 0.282s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-0ec52c53-fdc1-475d-8ee7-3956ba720d4f" released by "delete_volume" :: held 0.851s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Acquiring lock "cinder-quobyte-3e544dbf-4209-4d74-8436-2e73ce927305" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-3e544dbf-4209-4d74-8436-2e73ce927305" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[29591508-9b08-4309-b4c9-98a9a3c67534]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:17 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 Sep 22 18:22:17 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:17 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:17 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305 Sep 22 18:22:17 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:17 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3e544dbf-4209-4d74-8436-2e73ce927305" returned: 0 in 0.381s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "cinder-quobyte-3e544dbf-4209-4d74-8436-2e73ce927305" released by "delete_volume" :: held 0.847s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Created reservations ['5fec07cd-1e83-4828-8845-e43971f6aeec'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:17 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-809572863 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-809572863, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:22:17 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-809572863 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-809572863, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:22:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Created reservations ['cf6d3e21-d9df-4e22-9de2-4087850292f7', '9d0707e2-9950-4668-9d69-3e4e17421cf5', '332bc0bf-4c0b-4541-80f0-c447a65a2872', '7db33ae4-b4b0-4ec0-84f1-2c24f2819563'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Created reservations ['8e8bb645-d62f-41a3-8613-95770b7566d3', '3200a7a2-f669-47d8-817e-f36b5069ca56', 'd056dda8-98ff-4589-a8a2-2fd167d8722a', '4725b72b-a0c9-45ed-b811-4aa9b8b11b65'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:18 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:18 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:18 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.412s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f78083da-a304-4a94-9bdb-c519286473ce tempest-GroupsTest-617271241 None] Delete group completed successfully. Sep 22 18:22:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-57d0f19c-22a5-4de3-988c-e9eb6107b5cb req-6b0e8160-97ff-418f-9176-1b0701545ecc tempest-AttachVolumeNegativeTest-98167208 None] Terminate volume connection completed successfully. Sep 22 18:22:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-57d0f19c-22a5-4de3-988c-e9eb6107b5cb req-6b0e8160-97ff-418f-9176-1b0701545ecc tempest-AttachVolumeNegativeTest-98167208 None] Deleting attachment d0e628b7-ca8e-415c-9cc8-89258082172d. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:22:31 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=82,cinder:UPDATE=79,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:22:31 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=66,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Flow 'volume_create_manager' (6915f5d2-0d4e-4a55-89a8-db8e9ce05ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25adaba8-7b02-4632-8834-f42da8195f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25adaba8-7b02-4632-8834-f42da8195f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-964830035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a9bb8e-961c-4d60-8176-4438251ff805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b308e39e05481d9ca15c9455782328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:47Z,use_quota=True,user_id='ef4b9232f81043dca373c03663e422c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b935df3-5683-43a8-9e07-a3d1494a945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b935df3-5683-43a8-9e07-a3d1494a945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87bc31a-045a-40fe-85b3-ca243f52a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87bc31a-045a-40fe-85b3-ca243f52a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a9bb8e-961c-4d60-8176-4438251ff805', 'volume_name': 'volume-73a9bb8e-961c-4d60-8176-4438251ff805', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0153eb-cdc6-465a-b6ee-4e250af2d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0153eb-cdc6-465a-b6ee-4e250af2d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bc6e57-0539-467a-9ab3-84bd55040516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume 73a9bb8e-961c-4d60-8176-4438251ff805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a9bb8e-961c-4d60-8176-4438251ff805', 'volume_size': 1} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-964830035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a9bb8e-961c-4d60-8176-4438251ff805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b308e39e05481d9ca15c9455782328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:47Z,use_quota=True,user_id='ef4b9232f81043dca373c03663e422c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Creating volume 73a9bb8e-961c-4d60-8176-4438251ff805 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:47 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:47 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 1073741824 Sep 22 18:22:47 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:48 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 1073741824" returned: 0 in 0.464s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:48 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 Sep 22 18:22:48 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:48 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bc6e57-0539-467a-9ab3-84bd55040516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a9bb8e-961c-4d60-8176-4438251ff805', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b75775-14ca-450f-9f0f-53f91fdea122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume volume-73a9bb8e-961c-4d60-8176-4438251ff805 (73a9bb8e-961c-4d60-8176-4438251ff805): created successfully Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b75775-14ca-450f-9f0f-53f91fdea122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Flow 'volume_create_manager' (6915f5d2-0d4e-4a55-89a8-db8e9ce05ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f2c75859-edd3-4efd-a207-5bd42cbaca21 tempest-VolumeQuotasAdminTestJSON-291495626 None] Created volume successfully. Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:48 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:48 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:48 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:22:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "cinder-73a9bb8e-961c-4d60-8176-4438251ff805-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "cinder-73a9bb8e-961c-4d60-8176-4438251ff805-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "cinder-quobyte-73a9bb8e-961c-4d60-8176-4438251ff805" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "cinder-quobyte-73a9bb8e-961c-4d60-8176-4438251ff805" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffbda7-ba8d-4313-94c6-d7ffa165e54b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:49 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 Sep 22 18:22:49 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:50 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:50 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805 Sep 22 18:22:50 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:50 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-73a9bb8e-961c-4d60-8176-4438251ff805" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "cinder-quobyte-73a9bb8e-961c-4d60-8176-4438251ff805" released by "delete_volume" :: held 0.705s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Created reservations ['07bd132b-6741-4283-ad62-a2ee406b6f0d', '1fcc99f0-f1d1-48d6-896f-4451e76c7ffd', 'b986cf97-2fc0-41d3-954c-d1557ce3073b', '637fcb0b-5780-41d0-9466-15f0b60aaffd'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:50 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:50 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:50 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.300s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Deleted volume successfully. Sep 22 18:22:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a4fdf790-381b-4ff0-83b9-785f0567b348 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "cinder-73a9bb8e-961c-4d60-8176-4438251ff805-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Flow 'volume_create_manager' (5ba24940-dd15-49f7-b6d1-99352ac98f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9212f797-1181-47e8-a80b-e72c83bd04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9212f797-1181-47e8-a80b-e72c83bd04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1522389974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9a1549-8717-42b2-b144-9f5253e868bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b308e39e05481d9ca15c9455782328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:51Z,use_quota=True,user_id='ef4b9232f81043dca373c03663e422c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad7c38-418d-4d51-ba35-952c4041b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad7c38-418d-4d51-ba35-952c4041b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d5879a-6c00-48e8-8163-e13aa7f74338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d5879a-6c00-48e8-8163-e13aa7f74338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9a1549-8717-42b2-b144-9f5253e868bb', 'volume_name': 'volume-bb9a1549-8717-42b2-b144-9f5253e868bb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f780cc8b-f100-4adb-af22-9e5fb9502c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f780cc8b-f100-4adb-af22-9e5fb9502c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e269d2-bde0-40af-9c03-aeac02050503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume bb9a1549-8717-42b2-b144-9f5253e868bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9a1549-8717-42b2-b144-9f5253e868bb', 'volume_size': 1} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1522389974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9a1549-8717-42b2-b144-9f5253e868bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b308e39e05481d9ca15c9455782328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:51Z,use_quota=True,user_id='ef4b9232f81043dca373c03663e422c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Creating volume bb9a1549-8717-42b2-b144-9f5253e868bb {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:51 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:51 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb 1073741824 Sep 22 18:22:51 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:51 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb 1073741824" returned: 0 in 0.452s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:52 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb Sep 22 18:22:52 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:52 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb" returned: 0 in 0.270s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e269d2-bde0-40af-9c03-aeac02050503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9a1549-8717-42b2-b144-9f5253e868bb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c770f3e9-b9cb-4384-9bfa-845b608c066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:52 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Volume volume-bb9a1549-8717-42b2-b144-9f5253e868bb (bb9a1549-8717-42b2-b144-9f5253e868bb): created successfully Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c770f3e9-b9cb-4384-9bfa-845b608c066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Flow 'volume_create_manager' (5ba24940-dd15-49f7-b6d1-99352ac98f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b9d9cb24-3092-4766-ba5d-c0b80b7f8f62 tempest-VolumeQuotasAdminTestJSON-291495626 None] Created volume successfully. Sep 22 18:22:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-961c3991-d1a5-48b6-8a2f-3016fa197bd4 tempest-VolumeQuotasAdminTestJSON-84721670 None] Transfer volume completed successfully. Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Acquiring lock "cinder-bb9a1549-8717-42b2-b144-9f5253e868bb-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "cinder-bb9a1549-8717-42b2-b144-9f5253e868bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Acquiring lock "cinder-quobyte-bb9a1549-8717-42b2-b144-9f5253e868bb" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "cinder-quobyte-bb9a1549-8717-42b2-b144-9f5253e868bb" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b25c66-2ed0-4e0a-83c6-01a20521664b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:55 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb Sep 22 18:22:55 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:55 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb" returned: 0 in 0.406s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:55 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb Sep 22 18:22:55 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:55 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb9a1549-8717-42b2-b144-9f5253e868bb" returned: 0 in 0.308s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "cinder-quobyte-bb9a1549-8717-42b2-b144-9f5253e868bb" released by "delete_volume" :: held 0.773s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (c291dad6-bedd-4e20-87d5-444302efe0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cfaada-ac02-4381-b6de-4b20178edac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Created reservations ['4a654463-40d3-46dd-82f0-0d3f84f7325f', '40ebfaed-6cce-447d-ac7f-298cc6543610', '6c47cf53-fd93-4c59-b383-f12f0a0017e6', 'e3ced86e-41e4-4747-bfe6-7e1ddc8b7cfa'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cfaada-ac02-4381-b6de-4b20178edac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2050375068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5818ccee-590c-4729-b647-817b86e76754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9762c7ec19b464d8ad1669e29a982f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:56Z,use_quota=True,user_id='dca9df1baaaf4b4db7b0c43e47f4c628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0fd00b-5a30-42e8-8461-5f48222ad317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0fd00b-5a30-42e8-8461-5f48222ad317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c25253-fab4-4e4f-8c74-ef185c701f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c25253-fab4-4e4f-8c74-ef185c701f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5818ccee-590c-4729-b647-817b86e76754', 'volume_name': 'volume-5818ccee-590c-4729-b647-817b86e76754', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c38662-fb31-4bb4-b2dc-d0a68ab8d161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c38662-fb31-4bb4-b2dc-d0a68ab8d161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd9a7c5-d546-409a-bb29-87492524336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Volume 5818ccee-590c-4729-b647-817b86e76754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5818ccee-590c-4729-b647-817b86e76754', 'volume_size': 1} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2050375068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5818ccee-590c-4729-b647-817b86e76754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9762c7ec19b464d8ad1669e29a982f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:56Z,use_quota=True,user_id='dca9df1baaaf4b4db7b0c43e47f4c628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Creating volume 5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:56 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:56 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 1073741824 Sep 22 18:22:56 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:56 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:22:56 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:56 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:22:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Deleted volume successfully. Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a7ee294-eab0-4f02-bf9c-a8eaafee301c tempest-VolumeQuotasAdminTestJSON-1441555446 None] Lock "cinder-bb9a1549-8717-42b2-b144-9f5253e868bb-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:22:56 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 1073741824" returned: 0 in 0.774s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (32295eef-2fef-4c6a-89d1-4f445ae5c36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1d5383-9e77-4667-8664-89d8dceb44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1d5383-9e77-4667-8664-89d8dceb44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1734991787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7952dc44-c331-4ae1-8a3b-ddc356cd4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:57Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8546356-d2c3-4f17-a8c5-0a51a6569275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 Sep 22 18:22:56 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8546356-d2c3-4f17-a8c5-0a51a6569275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf039fa-7885-40a7-a3e8-058fcbd1d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf039fa-7885-40a7-a3e8-058fcbd1d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7952dc44-c331-4ae1-8a3b-ddc356cd4dce', 'volume_name': 'volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5d1c26-f82b-4410-884b-96e75215500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5d1c26-f82b-4410-884b-96e75215500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5725925b-cfaa-4706-875f-030208ced3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Volume 7952dc44-c331-4ae1-8a3b-ddc356cd4dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce', 'volume_size': 1} Sep 22 18:22:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:57 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1734991787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7952dc44-c331-4ae1-8a3b-ddc356cd4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:22:57Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Creating volume 7952dc44-c331-4ae1-8a3b-ddc356cd4dce {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:22:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd9a7c5-d546-409a-bb29-87492524336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5818ccee-590c-4729-b647-817b86e76754', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef5ad1-2967-4e34-af9a-47b41dbd2cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:57 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce 1073741824 Sep 22 18:22:57 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Volume volume-5818ccee-590c-4729-b647-817b86e76754 (5818ccee-590c-4729-b647-817b86e76754): created successfully Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef5ad1-2967-4e34-af9a-47b41dbd2cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (c291dad6-bedd-4e20-87d5-444302efe0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dc03f0ae-625c-4fc4-bc1c-6047f4b14f44 tempest-VolumesDeleteCascade-2109791389 None] Created volume successfully. Sep 22 18:22:57 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce 1073741824" returned: 0 in 0.453s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:57 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce Sep 22 18:22:57 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:57 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5725925b-cfaa-4706-875f-030208ced3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50800fd9-9449-4537-95d7-9209982c995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:22:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Volume volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce (7952dc44-c331-4ae1-8a3b-ddc356cd4dce): created successfully Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50800fd9-9449-4537-95d7-9209982c995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:22:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (32295eef-2fef-4c6a-89d1-4f445ae5c36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:22:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-61e4a69e-74cb-45f6-ab44-f3c0bf57e4b9 tempest-AttachVolumeTestJSON-1243952890 None] Created volume successfully. Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Creating offline snapshot 49c1aff0-2e41-49f7-9dce-f85393bd09c7 of volume 5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd9bdb-e6a3-4d86-a6ce-0272a2ae409f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:58 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 Sep 22 18:22:58 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:58 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:58 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 1G Sep 22 18:22:58 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:59 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 1G" returned: 0 in 0.492s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:59 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:22:59 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:59 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.389s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:59 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 is being set with open permissions: ugo+rw Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:59 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:22:59 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-72ee8308-0861-45de-a7cc-ba5f24a19b8d req-82f1dd5e-54ae-406b-878f-93f98477f7bd tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:22:59 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:22:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:22:59 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info Sep 22 18:22:59 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:00 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:00 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info is being set with open permissions: ugo+rw Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:00 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info Sep 22 18:23:00 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:00 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.info" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-72ee8308-0861-45de-a7cc-ba5f24a19b8d req-82f1dd5e-54ae-406b-878f-93f98477f7bd tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.684s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-72ee8308-0861-45de-a7cc-ba5f24a19b8d req-82f1dd5e-54ae-406b-878f-93f98477f7bd tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0f35cd55-ca21-49dc-849d-152eaebbca77 tempest-VolumesDeleteCascade-2109791389 None] Create snapshot completed successfully Sep 22 18:23:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-72ee8308-0861-45de-a7cc-ba5f24a19b8d req-82f1dd5e-54ae-406b-878f-93f98477f7bd tempest-AttachVolumeTestJSON-1243952890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e88a021d-9c06-4e67-ad50-ab9faba3553b', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:23:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-72ee8308-0861-45de-a7cc-ba5f24a19b8d req-82f1dd5e-54ae-406b-878f-93f98477f7bd tempest-AttachVolumeTestJSON-1243952890 None] attachment_update completed successfully. Sep 22 18:23:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Creating offline snapshot 2c31815d-289c-4c2a-a575-5090b57990d2 of volume 5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:23:01 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb369b7-d420-4eca-a291-b38e918eb825]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:01 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:23:01 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:02 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.477s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5818ccee-590c-4729-b647-817b86e76754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:02 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 1G Sep 22 18:23:02 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:02 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 1G" returned: 0 in 0.481s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:02 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 Sep 22 18:23:02 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:03 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2" returned: 0 in 0.295s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:03 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 is being set with open permissions: ugo+rw Sep 22 18:23:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:03 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 Sep 22 18:23:03 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:03 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.644s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4ceb4bfe-3747-4d25-9d67-16d78036afdd tempest-VolumesDeleteCascade-2109791389 None] Create snapshot completed successfully Sep 22 18:23:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-5818ccee-590c-4729-b647-817b86e76754-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-5818ccee-590c-4729-b647-817b86e76754-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Performing cascade delete. {{(pid=86046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-2c31815d-289c-4c2a-a575-5090b57990d2-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-2c31815d-289c-4c2a-a575-5090b57990d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-2c31815d-289c-4c2a-a575-5090b57990d2" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-2c31815d-289c-4c2a-a575-5090b57990d2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Deleting offline snapshot 2c31815d-289c-4c2a-a575-5090b57990d2 of volume 5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] snapshot_file for this snap is: volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92051c5d-abd3-40b5-8c8e-de1cfa012f16]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:04 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 Sep 22 18:23:04 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:04 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2" returned: 0 in 0.465s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5818ccee-590c-4729-b647-817b86e76754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1020988a-128a-44d4-af79-a015dec7ffe9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Flow 'volume_create_manager' (6459a464-f21b-4875-912b-31b4be1ceefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecee9da-c434-468f-ba21-a27e60ff345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecee9da-c434-468f-ba21-a27e60ff345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-286574666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd91cc-60e2-436a-a4c2-f0b9ddd999f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026a815d2b28440d8604b8eac6d828d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:05Z,use_quota=True,user_id='8654ee04cab44052a57dfe866766ce62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281642ca-e2fe-49aa-adc4-61dc936e254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281642ca-e2fe-49aa-adc4-61dc936e254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e750b26c-6eea-445c-9565-d6dd586c8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e750b26c-6eea-445c-9565-d6dd586c8639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dd91cc-60e2-436a-a4c2-f0b9ddd999f7', 'volume_name': 'volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a48e4-f06b-43d9-8dd0-67fbdbb57483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:05 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:23:05 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a48e4-f06b-43d9-8dd0-67fbdbb57483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d18cbbe-8d0c-4b8a-9407-4ea8cf52de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Volume 80dd91cc-60e2-436a-a4c2-f0b9ddd999f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7', 'volume_size': 1} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-286574666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd91cc-60e2-436a-a4c2-f0b9ddd999f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026a815d2b28440d8604b8eac6d828d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:05Z,use_quota=True,user_id='8654ee04cab44052a57dfe866766ce62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Creating volume 80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:05 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:05 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 1073741824 Sep 22 18:23:05 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:05 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.765s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5818ccee-590c-4729-b647-817b86e76754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:05 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 Sep 22 18:23:05 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:05 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 1073741824" returned: 0 in 0.863s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:06 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 Sep 22 18:23:06 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:06 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2" returned: 0 in 0.655s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:06 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2 Sep 22 18:23:06 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:06 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" returned: 0 in 0.371s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d18cbbe-8d0c-4b8a-9407-4ea8cf52de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c00f900-6f6c-4941-85dc-042aa1df11b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Volume volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 (80dd91cc-60e2-436a-a4c2-f0b9ddd999f7): created successfully Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c00f900-6f6c-4941-85dc-042aa1df11b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Flow 'volume_create_manager' (6459a464-f21b-4875-912b-31b4be1ceefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0ae6d036-ee84-4279-8cbe-3b73b4473bce tempest-VolumeQuotasNegativeTestJSON-893282069 None] Created volume successfully. Sep 22 18:23:06 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.2c31815d-289c-4c2a-a575-5090b57990d2" returned: 0 in 0.291s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-2c31815d-289c-4c2a-a575-5090b57990d2" released by "_delete_snapshot" :: held 2.342s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" released by "delete_snapshot" :: held 2.382s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['f1452c02-6961-476b-ae86-427e70a5f571', 'efc251a4-474a-41b1-86ec-7f3b3d64477a', 'ded3ebc5-9387-4722-bc48-d7089015eb5b', '8d27b45b-c7d1-48a6-bf88-a117f85414ba'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Delete snapshot completed successfully. Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-2c31815d-289c-4c2a-a575-5090b57990d2-delete_snapshot" released by "delete_snapshot" :: held 2.634s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-49c1aff0-2e41-49f7-9dce-f85393bd09c7-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-49c1aff0-2e41-49f7-9dce-f85393bd09c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-49c1aff0-2e41-49f7-9dce-f85393bd09c7" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-49c1aff0-2e41-49f7-9dce-f85393bd09c7" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Deleting offline snapshot 49c1aff0-2e41-49f7-9dce-f85393bd09c7 of volume 5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:23:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] snapshot_file for this snap is: volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac092b-9295-4450-a68e-23705e6359ef]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:07 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:23:07 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (2d89ca68-d9fe-4565-90b5-55aa79b80109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40755fe-90fd-4376-bbc3-47a5d603ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40755fe-90fd-4376-bbc3-47a5d603ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-255109847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ee7f4b-3630-49fa-a56f-9b3c6c502397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:07Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592a5996-b2ef-4e99-ae5d-c98117469d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592a5996-b2ef-4e99-ae5d-c98117469d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72002e36-5000-432f-b25e-7cc69536bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72002e36-5000-432f-b25e-7cc69536bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ee7f4b-3630-49fa-a56f-9b3c6c502397', 'volume_name': 'volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a76756-db17-4e2c-91a8-7ae1d2032fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a76756-db17-4e2c-91a8-7ae1d2032fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6db8be-3aad-4cbd-b629-9074de49bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Volume 19ee7f4b-3630-49fa-a56f-9b3c6c502397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397', 'volume_size': 1} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-255109847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ee7f4b-3630-49fa-a56f-9b3c6c502397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:07Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Creating volume 19ee7f4b-3630-49fa-a56f-9b3c6c502397 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:07 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:07 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 1073741824 Sep 22 18:23:07 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:07 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.870s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5818ccee-590c-4729-b647-817b86e76754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[99efb053-b764-47f4-afea-7d0cba42a352]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:08 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 Sep 22 18:23:08 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:08 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 1073741824" returned: 0 in 0.757s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:08 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 Sep 22 18:23:08 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:08 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754" returned: 0 in 0.613s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:08 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:23:08 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:09 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397" returned: 0 in 0.621s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6db8be-3aad-4cbd-b629-9074de49bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d20235-6a50-4f85-a871-694bf0dfaf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Volume volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 (19ee7f4b-3630-49fa-a56f-9b3c6c502397): created successfully Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d20235-6a50-4f85-a871-694bf0dfaf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (2d89ca68-d9fe-4565-90b5-55aa79b80109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0b87d9e6-b772-4ff1-8900-25c508063e55 tempest-AttachVolumeNegativeTest-98167208 None] Created volume successfully. Sep 22 18:23:09 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Acquiring lock "cinder-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.702s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "cinder-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:09 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7 Sep 22 18:23:09 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Acquiring lock "cinder-quobyte-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "cinder-quobyte-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdfd792-4cee-4a2d-b5bc-db6fc518544d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:09 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 Sep 22 18:23:09 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:09 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754.49c1aff0-2e41-49f7-9dce-f85393bd09c7" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-49c1aff0-2e41-49f7-9dce-f85393bd09c7" released by "_delete_snapshot" :: held 2.799s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" released by "delete_snapshot" :: held 2.865s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['0c13abf3-b019-4bf3-a475-1c3e6381f063', '3f5354ab-561e-42aa-8ebe-0235d9466801', '128d55b4-4b6f-4684-afa3-9cee1955747b', '317065d0-a7cc-43de-8e5a-091e3c65b8d6'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Delete snapshot completed successfully. Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-49c1aff0-2e41-49f7-9dce-f85393bd09c7-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Snapshots deleted, issuing volume delete {{(pid=86046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce388105-a4d6-4aff-8f94-115470fa7553]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:10 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" returned: 0 in 0.664s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:10 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7 Sep 22 18:23:10 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:10 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 Sep 22 18:23:10 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-77b77b32-0c55-4d35-84f6-60cd8e292c3c req-288784f0-c6f6-4f62-9960-082e3b762a35 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-77b77b32-0c55-4d35-84f6-60cd8e292c3c req-288784f0-c6f6-4f62-9960-082e3b762a35 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-77b77b32-0c55-4d35-84f6-60cd8e292c3c req-288784f0-c6f6-4f62-9960-082e3b762a35 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-77b77b32-0c55-4d35-84f6-60cd8e292c3c req-288784f0-c6f6-4f62-9960-082e3b762a35 tempest-AttachVolumeNegativeTest-98167208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed657c33-f784-42ab-9f69-767458598676', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:23:10 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" returned: 0 in 0.452s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:10 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "cinder-quobyte-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7" released by "delete_volume" :: held 1.192s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754" returned: 0 in 0.558s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:10 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754 Sep 22 18:23:10 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-77b77b32-0c55-4d35-84f6-60cd8e292c3c req-288784f0-c6f6-4f62-9960-082e3b762a35 tempest-AttachVolumeNegativeTest-98167208 None] attachment_update completed successfully. Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Created reservations ['e48f4016-1b84-4c80-b9c6-fc74edc3158e', 'f8dd1ee9-6765-43aa-8492-e265b0486b72', '953b98f7-57f6-4973-9061-3705a0e9f61a', '021d3f73-3809-4a21-b46a-44751e37428b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:10 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:10 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:10 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5818ccee-590c-4729-b647-817b86e76754" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-5818ccee-590c-4729-b647-817b86e76754" released by "delete_volume" :: held 1.005s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['7f4d24ad-d553-499c-9cc4-837c36a47a0b', 'd997d26a-40e8-49e9-bf92-e95e055b5853', '21ebdcfa-549b-453e-af86-b612c4da3f12', 'd1ff5174-9a11-45cc-a339-d07da699815e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:11 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.398s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Deleted volume successfully. Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a6e94086-75ba-4b47-b760-c09d895c14b4 tempest-VolumeQuotasNegativeTestJSON-893282069 None] Lock "cinder-80dd91cc-60e2-436a-a4c2-f0b9ddd999f7-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:11 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:11 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:11 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.295s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Deleted volume successfully. Sep 22 18:23:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-186317f8-8959-4c2f-b79a-8bc3a86aa2ba tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-5818ccee-590c-4729-b647-817b86e76754-delete_volume" released by "delete_volume" :: held 7.541s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (454216c3-cd82-4852-97b6-ab0c1ad022c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289021bb-588e-4d9b-9655-fcd4ffbb9386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289021bb-588e-4d9b-9655-fcd4ffbb9386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431424011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005dbe1b-6156-4d58-8db8-7536ec2030bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9762c7ec19b464d8ad1669e29a982f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:13Z,use_quota=True,user_id='dca9df1baaaf4b4db7b0c43e47f4c628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324348b3-8699-4487-bc36-e031cc00b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324348b3-8699-4487-bc36-e031cc00b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3b2fd1-273a-4466-b56a-5b942bba5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3b2fd1-273a-4466-b56a-5b942bba5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005dbe1b-6156-4d58-8db8-7536ec2030bc', 'volume_name': 'volume-005dbe1b-6156-4d58-8db8-7536ec2030bc', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e695ea-1582-44ae-b770-87a4ea3bfda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e695ea-1582-44ae-b770-87a4ea3bfda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cffda1a-4c6b-46a4-beee-9d5c5cbb8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:13 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Volume 005dbe1b-6156-4d58-8db8-7536ec2030bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005dbe1b-6156-4d58-8db8-7536ec2030bc', 'volume_size': 1} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431424011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005dbe1b-6156-4d58-8db8-7536ec2030bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9762c7ec19b464d8ad1669e29a982f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:13Z,use_quota=True,user_id='dca9df1baaaf4b4db7b0c43e47f4c628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Creating volume 005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:13 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:13 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc 1073741824 Sep 22 18:23:13 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-a0c24b48-dbbb-4ac5-b759-4103e2250854 req-0b87d30f-748c-4fa1-9289-6d4c757ee6ae tempest-AttachVolumeNegativeTest-98167208 None] Terminate volume connection completed successfully. Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-a0c24b48-dbbb-4ac5-b759-4103e2250854 req-0b87d30f-748c-4fa1-9289-6d4c757ee6ae tempest-AttachVolumeNegativeTest-98167208 None] Deleting attachment ed657c33-f784-42ab-9f69-767458598676. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:23:13 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc 1073741824" returned: 0 in 0.620s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:13 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:13 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:14 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cffda1a-4c6b-46a4-beee-9d5c5cbb8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005dbe1b-6156-4d58-8db8-7536ec2030bc', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c91817-cc24-43f0-b857-cf5be53c2dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:14 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Volume volume-005dbe1b-6156-4d58-8db8-7536ec2030bc (005dbe1b-6156-4d58-8db8-7536ec2030bc): created successfully Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c91817-cc24-43f0-b857-cf5be53c2dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (454216c3-cd82-4852-97b6-ab0c1ad022c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8a2fa6a1-e288-491c-a82f-22d1116b3ee8 tempest-VolumesDeleteCascade-2109791389 None] Created volume successfully. Sep 22 18:23:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Creating offline snapshot bff8f037-5b1d-4b4a-b5aa-6927f71ab117 of volume 005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:23:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5915d0-9213-443b-879e-bb7302c98148]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:15 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:15 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:16 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.708s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:16 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 1G Sep 22 18:23:16 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:17 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 1G" returned: 0 in 0.602s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005dbe1b-6156-4d58-8db8-7536ec2030bc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:17 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005dbe1b-6156-4d58-8db8-7536ec2030bc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:17 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:17 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005dbe1b-6156-4d58-8db8-7536ec2030bc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:17 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 is being set with open permissions: ugo+rw Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:17 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:17 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:17 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.319s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:17 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info Sep 22 18:23:17 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:18 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info" returned: 0 in 0.550s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:18 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info is being set with open permissions: ugo+rw Sep 22 18:23:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:18 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info Sep 22 18:23:18 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:18 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.info" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dd1cf22b-6e2b-4dda-87b0-b0535c92f74b tempest-VolumesDeleteCascade-2109791389 None] Create snapshot completed successfully Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (60f09fc2-d4f1-446c-9be6-b4839d004995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca24f06d-9f83-407d-ac8a-8c472ee317bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca24f06d-9f83-407d-ac8a-8c472ee317bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-425535058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d815e7-d21a-438a-9040-61d4bce62467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9762c7ec19b464d8ad1669e29a982f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bff8f037-5b1d-4b4a-b5aa-6927f71ab117,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:21Z,use_quota=True,user_id='dca9df1baaaf4b4db7b0c43e47f4c628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2363531f-c80c-45af-9d64-8f8fabd5ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2363531f-c80c-45af-9d64-8f8fabd5ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8b2bc-b952-4243-8688-e48207f0e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8b2bc-b952-4243-8688-e48207f0e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61d815e7-d21a-438a-9040-61d4bce62467', 'volume_name': 'volume-61d815e7-d21a-438a-9040-61d4bce62467', 'volume_size': 1, 'snapshot_id': 'bff8f037-5b1d-4b4a-b5aa-6927f71ab117'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da2f68b-d980-4392-af88-0b2bbf6bde41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da2f68b-d980-4392-af88-0b2bbf6bde41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1995df-2084-4423-96a3-137331f131d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Volume 61d815e7-d21a-438a-9040-61d4bce62467: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61d815e7-d21a-438a-9040-61d4bce62467', 'volume_size': 1, 'snapshot_id': 'bff8f037-5b1d-4b4a-b5aa-6927f71ab117'} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-61d815e7-d21a-438a-9040-61d4bce62467" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-61d815e7-d21a-438a-9040-61d4bce62467" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Creating volume 61d815e7-d21a-438a-9040-61d4bce62467 from snapshot bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] snapshot: bff8f037-5b1d-4b4a-b5aa-6927f71ab117, volume: 61d815e7-d21a-438a-9040-61d4bce62467, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d57afa-a64c-4151-bcd0-51e753626054]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:21 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:21 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Flow 'volume_create_manager' (592726c5-6f5d-46b4-809f-d3d5cad2563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d6c6ba-c1b6-482d-9872-54893fb88e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d6c6ba-c1b6-482d-9872-54893fb88e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-219741089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc872fb-5e02-43f3-a9de-606c1fb3aba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194734af4ad4ba1913c3dc791563668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:21Z,use_quota=True,user_id='4ab46f184b8c45dcab191f269bdb6b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60294a88-8c39-479d-bad3-980df7d25d07),volume_type_id=60294a88-8c39-479d-bad3-980df7d25d07)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c072d4-2c07-471d-a745-04a3f9e44100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c072d4-2c07-471d-a745-04a3f9e44100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b550014-519b-497a-853d-7cb9e0054c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b550014-519b-497a-853d-7cb9e0054c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc872fb-5e02-43f3-a9de-606c1fb3aba7', 'volume_name': 'volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127896f1-5533-497e-b431-a853d05936ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127896f1-5533-497e-b431-a853d05936ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff526e1-27f6-44b5-ba49-2e000e50ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:21 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Volume 2dc872fb-5e02-43f3-a9de-606c1fb3aba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7', 'volume_size': 1} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:21 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.562s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005dbe1b-6156-4d58-8db8-7536ec2030bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[25070f24-7210-475a-ac20-79cd9c767b35]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:21 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:21 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:22 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.456s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:23:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:23:22 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:23:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:22 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 Sep 22 18:23:22 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:30 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467" returned: 0 in 7.817s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:23:30 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Converted 1024.00 MB image at 130.97 MB/s Sep 22 18:23:30 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 is being set with open permissions: ugo+rw Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:30 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 Sep 22 18:23:30 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:30 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467" returned: 0 in 0.333s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" released by "_copy_volume_from_snapshot" :: held 9.310s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-61d815e7-d21a-438a-9040-61d4bce62467" released by "_create_volume_from_snapshot" :: held 9.416s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.446s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.856s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-219741089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc872fb-5e02-43f3-a9de-606c1fb3aba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194734af4ad4ba1913c3dc791563668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:21Z,use_quota=True,user_id='4ab46f184b8c45dcab191f269bdb6b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60294a88-8c39-479d-bad3-980df7d25d07),volume_type_id=60294a88-8c39-479d-bad3-980df7d25d07)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Creating volume 2dc872fb-5e02-43f3-a9de-606c1fb3aba7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:30 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:30 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 1073741824 Sep 22 18:23:30 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1995df-2084-4423-96a3-137331f131d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d815e7-d21a-438a-9040-61d4bce62467', 'volume_size': 1, 'snapshot_id': 'bff8f037-5b1d-4b4a-b5aa-6927f71ab117'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578a552f-e398-4b33-86a1-27ff545e214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:30 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Volume volume-61d815e7-d21a-438a-9040-61d4bce62467 (61d815e7-d21a-438a-9040-61d4bce62467): created successfully Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578a552f-e398-4b33-86a1-27ff545e214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Flow 'volume_create_manager' (60f09fc2-d4f1-446c-9be6-b4839d004995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:30 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-47b31a13-ebf5-4b6b-b2af-7d2d628e08f6 tempest-VolumesDeleteCascade-2109791389 None] Created volume successfully. Sep 22 18:23:30 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 1073741824" returned: 0 in 0.524s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:31 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 Sep 22 18:23:31 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:31 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" returned: 0 in 0.329s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff526e1-27f6-44b5-ba49-2e000e50ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b35adb-414a-4eb9-a2c0-a0967f7adf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:31 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Volume volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 (2dc872fb-5e02-43f3-a9de-606c1fb3aba7): created successfully Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b35adb-414a-4eb9-a2c0-a0967f7adf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Flow 'volume_create_manager' (592726c5-6f5d-46b4-809f-d3d5cad2563f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=72,cinder:SELECT=67,cinder:INSERT=18,cinder:DELETE=10 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:23:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1bb62b14-7a36-4b86-8b57-acf82f02dee3 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Created volume successfully. Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=82,cinder:UPDATE=83,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-005dbe1b-6156-4d58-8db8-7536ec2030bc-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-005dbe1b-6156-4d58-8db8-7536ec2030bc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Performing cascade delete. {{(pid=86046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 18:23:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Deleting offline snapshot bff8f037-5b1d-4b4a-b5aa-6927f71ab117 of volume 005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] snapshot_file for this snap is: volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ec162-50c3-46ab-825d-b023595d7ad2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:32 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:32 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:33 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.962s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005dbe1b-6156-4d58-8db8-7536ec2030bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b175e-4635-4067-b60f-f059ac8620b9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:33 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:33 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:33 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:33 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:34 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.372s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6788312a-f09d-434a-a3ea-964ca22ccb02 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Retype volume completed successfully. Sep 22 18:23:34 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.932s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:34 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:34 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-453336a6-060d-4e7d-a29c-1928932c25b2 req-4e250bc3-f138-4cf3-857e-5c0886faeb57 tempest-AttachVolumeTestJSON-1243952890 None] Terminate volume connection completed successfully. Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-453336a6-060d-4e7d-a29c-1928932c25b2 req-4e250bc3-f138-4cf3-857e-5c0886faeb57 tempest-AttachVolumeTestJSON-1243952890 None] Deleting attachment e88a021d-9c06-4e67-ad50-ab9faba3553b. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:23:34 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.735s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "cinder-2dc872fb-5e02-43f3-a9de-606c1fb3aba7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:34 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117 Sep 22 18:23:34 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "cinder-2dc872fb-5e02-43f3-a9de-606c1fb3aba7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "cinder-quobyte-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "cinder-quobyte-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c24fc5-fb3d-425b-9f62-e298aff03e83]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:35 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 Sep 22 18:23:35 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:35 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc.bff8f037-5b1d-4b4a-b5aa-6927f71ab117" returned: 0 in 0.505s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-bff8f037-5b1d-4b4a-b5aa-6927f71ab117" released by "_delete_snapshot" :: held 3.357s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" released by "delete_snapshot" :: held 3.396s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['ea66e48e-7db5-430e-a12e-8632f5506bd9', '4f550711-fae1-40bd-980d-17e7a5a8c464', '2e765d68-ffba-4812-9278-2b84dc7829d4', '6c9674d7-a23e-41b1-bc5c-ea2cafa23b67'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Delete snapshot completed successfully. Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-bff8f037-5b1d-4b4a-b5aa-6927f71ab117-delete_snapshot" released by "delete_snapshot" :: held 3.631s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Snapshots deleted, issuing volume delete {{(pid=86046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:35 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" returned: 0 in 0.532s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" acquired by "delete_volume" :: waited 0.047s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:35 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7 Sep 22 18:23:35 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07e3a1-a7e7-4244-b9e6-810ffa065a42]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:35 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:35 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:36 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" returned: 0 in 0.396s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "cinder-quobyte-2dc872fb-5e02-43f3-a9de-606c1fb3aba7" released by "delete_volume" :: held 1.043s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:36 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:23:36 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Created reservations ['bd509524-12e5-4750-8e3a-4a2522f0616a', 'd91b7c7a-9e42-472b-a32f-afcf15668d63', '52dea060-0e8e-43fb-89c6-2af39614bf34', '7ca759c7-713d-40f4-aa1d-541393c3f189'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:36 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.570s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:36 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:36 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:36 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc Sep 22 18:23:36 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:36 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.330s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Deleted volume successfully. Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f16bd997-7c0b-479f-8692-4c5424ed40d8 tempest-VolumeRetypeWithoutMigrationTest-880190886 None] Lock "cinder-2dc872fb-5e02-43f3-a9de-606c1fb3aba7-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:36 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-005dbe1b-6156-4d58-8db8-7536ec2030bc" returned: 0 in 0.479s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-005dbe1b-6156-4d58-8db8-7536ec2030bc" released by "delete_volume" :: held 1.151s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:36 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['364d19b9-e126-45ce-b433-2b82105da981', '8c20fc49-b253-4c75-9b22-abbefb5a7bde', '1c82e678-72c9-49e5-a0e6-39871129263f', '9c8a6b14-50ed-4e21-9e31-6217c515b7b2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:37 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:37 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-61d815e7-d21a-438a-9040-61d4bce62467-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-61d815e7-d21a-438a-9040-61d4bce62467-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:37 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.551s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Deleted volume successfully. Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea25e619-f0b1-4ba5-a6e8-a4f775dcd541]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f013a6ae-c2ad-4974-9a5e-769432f14190 tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-005dbe1b-6156-4d58-8db8-7536ec2030bc-delete_volume" released by "delete_volume" :: held 5.881s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:37 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 Sep 22 18:23:37 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:38 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467" returned: 0 in 0.632s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:38 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467 Sep 22 18:23:38 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:38 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-61d815e7-d21a-438a-9040-61d4bce62467" returned: 0 in 0.622s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-quobyte-61d815e7-d21a-438a-9040-61d4bce62467" released by "delete_volume" :: held 1.340s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Created reservations ['ce3a5f16-4c8b-4456-8423-d9d66b515458', '8ffb5fc5-89d3-4c69-bea0-a8efc0f5e6cc', '2737d607-7b90-441a-8110-b74a97579dc1', '81f65958-818b-45a6-b1a6-1076dc719d11'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:39 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:39 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:39 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.497s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Deleted volume successfully. Sep 22 18:23:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9c4ad110-e76e-42b3-979b-98255277d5fb tempest-VolumesDeleteCascade-2109791389 None] Lock "cinder-61d815e7-d21a-438a-9040-61d4bce62467-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:48 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:48 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:48 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.297s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:23:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Flow 'volume_create_manager' (c001d4e9-fba8-4584-8831-20ea6a9d8584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a16141-b4ce-404e-b81a-3fa8742a4b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a16141-b4ce-404e-b81a-3fa8742a4b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-440865172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7353b090-caad-472a-ae85-40714c66fd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1269de1a3da4eeebf3bc4967374560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:49Z,use_quota=True,user_id='bc395600577b4667909aa89f020a37e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceef759c-a3f5-460d-9022-cd40a933403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceef759c-a3f5-460d-9022-cd40a933403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26323464-913c-4fc4-8187-5dbb1120fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26323464-913c-4fc4-8187-5dbb1120fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7353b090-caad-472a-ae85-40714c66fd9f', 'volume_name': 'volume-7353b090-caad-472a-ae85-40714c66fd9f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298b7194-7b15-4eaf-902e-d867830268c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298b7194-7b15-4eaf-902e-d867830268c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb07f67-035e-4cce-a789-4ef5300f5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Volume 7353b090-caad-472a-ae85-40714c66fd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7353b090-caad-472a-ae85-40714c66fd9f', 'volume_size': 1} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-440865172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7353b090-caad-472a-ae85-40714c66fd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1269de1a3da4eeebf3bc4967374560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:49Z,use_quota=True,user_id='bc395600577b4667909aa89f020a37e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Creating volume 7353b090-caad-472a-ae85-40714c66fd9f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:49 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:49 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f 1073741824 Sep 22 18:23:49 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:49 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f 1073741824" returned: 0 in 0.504s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:49 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f Sep 22 18:23:49 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Flow 'volume_create_manager' (d0a48616-ae5f-42db-98a3-b8e8ea3035ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0536242-227c-4b03-82a8-90db6431af9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0536242-227c-4b03-82a8-90db6431af9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1126917923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90942623-e520-485f-b1e0-52009998e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84101801f0064eb0aeef0506f3de59e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:50Z,use_quota=True,user_id='bb4d56ec2f5f4ad9a15c3925b4f88b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3233a4ae-39b6-43c4-aa22-c9b0c2809190),volume_type_id=3233a4ae-39b6-43c4-aa22-c9b0c2809190)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd97cd4-1c6c-4075-b4ec-b5522938ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd97cd4-1c6c-4075-b4ec-b5522938ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338ca43-c4f9-4c65-8345-76816a2e2a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e338ca43-c4f9-4c65-8345-76816a2e2a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90942623-e520-485f-b1e0-52009998e3ff', 'volume_name': 'volume-90942623-e520-485f-b1e0-52009998e3ff', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58636b5c-c2c6-4ebc-a7dc-f902d08e0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58636b5c-c2c6-4ebc-a7dc-f902d08e0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201de2e2-fa15-4487-a6aa-dbafad19c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Volume 90942623-e520-485f-b1e0-52009998e3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90942623-e520-485f-b1e0-52009998e3ff', 'volume_size': 1} Sep 22 18:23:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:50 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f" returned: 0 in 0.295s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.117s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1126917923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90942623-e520-485f-b1e0-52009998e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84101801f0064eb0aeef0506f3de59e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:50Z,use_quota=True,user_id='bb4d56ec2f5f4ad9a15c3925b4f88b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3233a4ae-39b6-43c4-aa22-c9b0c2809190),volume_type_id=3233a4ae-39b6-43c4-aa22-c9b0c2809190)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Creating volume 90942623-e520-485f-b1e0-52009998e3ff {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:50 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb07f67-035e-4cce-a789-4ef5300f5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7353b090-caad-472a-ae85-40714c66fd9f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:50 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff 1073741824 Sep 22 18:23:50 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b877a3bf-b0f4-4374-9d44-4ef459ed6a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Volume volume-7353b090-caad-472a-ae85-40714c66fd9f (7353b090-caad-472a-ae85-40714c66fd9f): created successfully Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b877a3bf-b0f4-4374-9d44-4ef459ed6a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Flow 'volume_create_manager' (c001d4e9-fba8-4584-8831-20ea6a9d8584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bc97fadd-5790-4b05-944a-17a4d8c8789a tempest-VolumesTransfersTest-373307335 None] Created volume successfully. Sep 22 18:23:50 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff 1073741824" returned: 0 in 0.417s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:50 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff Sep 22 18:23:50 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:50 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff" returned: 0 in 0.255s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201de2e2-fa15-4487-a6aa-dbafad19c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90942623-e520-485f-b1e0-52009998e3ff', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c8ad26-fa00-49b9-8c82-666298dfebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Volume volume-90942623-e520-485f-b1e0-52009998e3ff (90942623-e520-485f-b1e0-52009998e3ff): created successfully Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c8ad26-fa00-49b9-8c82-666298dfebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Flow 'volume_create_manager' (d0a48616-ae5f-42db-98a3-b8e8ea3035ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-555f59df-f532-47d7-93db-8ba627a5cb12 tempest-VolumeTypesAccessTest-1896455585 None] Created volume successfully. Sep 22 18:23:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dd44257e-cc5e-420e-8ba3-268d456d08b3 tempest-VolumesTransfersTest-1825147614 None] Transfer volume completed successfully. Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Acquiring lock "cinder-90942623-e520-485f-b1e0-52009998e3ff-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "cinder-90942623-e520-485f-b1e0-52009998e3ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Acquiring lock "cinder-quobyte-90942623-e520-485f-b1e0-52009998e3ff" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "cinder-quobyte-90942623-e520-485f-b1e0-52009998e3ff" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[98935156-91fc-47a5-8a7f-926692e9cae2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:52 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff Sep 22 18:23:52 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:52 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff" returned: 0 in 0.413s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Acquiring lock "cinder-7353b090-caad-472a-ae85-40714c66fd9f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:52 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff Sep 22 18:23:52 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "cinder-7353b090-caad-472a-ae85-40714c66fd9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Acquiring lock "cinder-quobyte-7353b090-caad-472a-ae85-40714c66fd9f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "cinder-quobyte-7353b090-caad-472a-ae85-40714c66fd9f" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ee944-cbcb-4c96-99ca-b5db4db21063]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:52 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f Sep 22 18:23:52 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:52 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-90942623-e520-485f-b1e0-52009998e3ff" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "cinder-quobyte-90942623-e520-485f-b1e0-52009998e3ff" released by "delete_volume" :: held 0.822s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:52 devstack cinder-volume[86046]: WARNING cinder.quota [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-838082627 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-838082627, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:23:52 devstack cinder-volume[86046]: WARNING cinder.quota [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-838082627 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-838082627, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Created reservations ['e67e9d67-4639-445d-a5c2-67bd33e16ffb', '7f5134e2-82e9-4e31-8caf-5d052619206e', '2cccf0e4-2ec9-4314-86a4-3562c8e388b9', 'f1da2958-4134-4d11-99a3-aec3481359a1'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:53 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:53 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:53 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f" returned: 0 in 0.412s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:53 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f Sep 22 18:23:53 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:53 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.322s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:53 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Deleted volume successfully. Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-893c756f-99e7-410f-9543-11d89ee11f56 tempest-VolumeTypesAccessTest-1896455585 None] Lock "cinder-90942623-e520-485f-b1e0-52009998e3ff-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:53 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7353b090-caad-472a-ae85-40714c66fd9f" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "cinder-quobyte-7353b090-caad-472a-ae85-40714c66fd9f" released by "delete_volume" :: held 0.841s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Created reservations ['3cdafa83-669d-45ad-9f16-303f1947ef6e', 'ec2be3be-9b54-4ca2-ae65-1ae5e6052bdd', '95e47450-49ba-4df7-aa5f-af64b27476a2', 'f4905484-f048-47c4-b6d0-f1b1e9eb7523'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:53 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:53 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:53 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.308s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Deleted volume successfully. Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a69fcf72-e35e-4c42-86ce-36fd218cf4fa tempest-VolumesTransfersTest-170851989 None] Lock "cinder-7353b090-caad-472a-ae85-40714c66fd9f-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Flow 'volume_create_manager' (e1ac171f-111d-4f0f-b3e0-66a9dbb8dd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a1e79f-60e2-47c1-b1ed-7ae2fa6fdf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a1e79f-60e2-47c1-b1ed-7ae2fa6fdf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2103801443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2837f2-452b-48eb-8127-e979aca50bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1269de1a3da4eeebf3bc4967374560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:55Z,use_quota=True,user_id='bc395600577b4667909aa89f020a37e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a450b-253a-4695-8e57-a482fccbb804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a450b-253a-4695-8e57-a482fccbb804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e386cf-c410-4928-85dd-bc0e7022a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e386cf-c410-4928-85dd-bc0e7022a01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2837f2-452b-48eb-8127-e979aca50bc4', 'volume_name': 'volume-4d2837f2-452b-48eb-8127-e979aca50bc4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36592c6b-eade-470f-a62a-62ff1079184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36592c6b-eade-470f-a62a-62ff1079184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd78dbce-5d44-492d-b4e9-7ad4ef9b0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Volume 4d2837f2-452b-48eb-8127-e979aca50bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2837f2-452b-48eb-8127-e979aca50bc4', 'volume_size': 1} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2103801443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2837f2-452b-48eb-8127-e979aca50bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1269de1a3da4eeebf3bc4967374560d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:55Z,use_quota=True,user_id='bc395600577b4667909aa89f020a37e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Creating volume 4d2837f2-452b-48eb-8127-e979aca50bc4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:54 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 1073741824 Sep 22 18:23:54 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:55 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 1073741824" returned: 0 in 0.627s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:55 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 Sep 22 18:23:55 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:55 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd78dbce-5d44-492d-b4e9-7ad4ef9b0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2837f2-452b-48eb-8127-e979aca50bc4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87d57d-d8ab-4a34-923a-6cc87d081af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Volume volume-4d2837f2-452b-48eb-8127-e979aca50bc4 (4d2837f2-452b-48eb-8127-e979aca50bc4): created successfully Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87d57d-d8ab-4a34-923a-6cc87d081af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Flow 'volume_create_manager' (e1ac171f-111d-4f0f-b3e0-66a9dbb8dd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6b993f57-1278-4723-b0c6-f3e120e1a6ea tempest-VolumesTransfersTest-373307335 None] Created volume successfully. Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Acquiring lock "cinder-4d2837f2-452b-48eb-8127-e979aca50bc4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "cinder-4d2837f2-452b-48eb-8127-e979aca50bc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Acquiring lock "cinder-quobyte-4d2837f2-452b-48eb-8127-e979aca50bc4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "cinder-quobyte-4d2837f2-452b-48eb-8127-e979aca50bc4" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efb032-0ff8-4d43-bfb8-b337881e83fe]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:57 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 Sep 22 18:23:57 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:57 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:57 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4 Sep 22 18:23:57 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:57 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d2837f2-452b-48eb-8127-e979aca50bc4" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "cinder-quobyte-4d2837f2-452b-48eb-8127-e979aca50bc4" released by "delete_volume" :: held 0.696s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:57 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Created reservations ['12d94514-86cc-4fd6-8933-632a0da46b2c', '7b532065-e69e-4a05-9909-c58df5a4c678', '0c016286-135b-482d-be55-5cbcd0a84c6d', 'b06ac914-69fc-4ebf-bcb2-e8ae20025ef0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:58 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:23:58 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:58 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:23:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Deleted volume successfully. Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d90297-c891-49ce-84ad-9e91238f72dd tempest-VolumesTransfersTest-170851989 None] Lock "cinder-4d2837f2-452b-48eb-8127-e979aca50bc4-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (2b7f6af9-1505-47c0-8147-1878dc9c053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0680d0a0-edac-49eb-b5b5-6f6c266014e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0680d0a0-edac-49eb-b5b5-6f6c266014e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990704046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aff0b5-a2e5-446f-b1ba-832114e0851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:59Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e71c4-a4c6-48a5-a65d-b88cc946cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e71c4-a4c6-48a5-a65d-b88cc946cad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43766b-1b6c-40eb-8151-6d2cad2d840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43766b-1b6c-40eb-8151-6d2cad2d840f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29aff0b5-a2e5-446f-b1ba-832114e0851c', 'volume_name': 'volume-29aff0b5-a2e5-446f-b1ba-832114e0851c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1681e2-27ba-4f04-8528-27efe1fe0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1681e2-27ba-4f04-8528-27efe1fe0961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0180867b-0850-4c8b-b504-447b9a2f0490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Volume 29aff0b5-a2e5-446f-b1ba-832114e0851c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29aff0b5-a2e5-446f-b1ba-832114e0851c', 'volume_size': 1} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990704046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aff0b5-a2e5-446f-b1ba-832114e0851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4860de2b34a431686fb239be9aa503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:23:59Z,use_quota=True,user_id='1d32f30f1fc9408e82352af948db48c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Creating volume 29aff0b5-a2e5-446f-b1ba-832114e0851c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:23:58 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:23:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:58 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c 1073741824 Sep 22 18:23:58 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:59 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c 1073741824" returned: 0 in 0.497s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:23:59 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c Sep 22 18:23:59 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:23:59 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0180867b-0850-4c8b-b504-447b9a2f0490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29aff0b5-a2e5-446f-b1ba-832114e0851c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d729d415-f87b-4c80-a5a7-6030c1e58f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:23:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Volume volume-29aff0b5-a2e5-446f-b1ba-832114e0851c (29aff0b5-a2e5-446f-b1ba-832114e0851c): created successfully Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d729d415-f87b-4c80-a5a7-6030c1e58f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:23:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Flow 'volume_create_manager' (2b7f6af9-1505-47c0-8147-1878dc9c053f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:23:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6fbbfffa-03d0-4d7e-b2b6-9104f78a353b tempest-AttachVolumeNegativeTest-98167208 None] Created volume successfully. Sep 22 18:24:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-fcc6c73a-a95e-4fa4-ba59-87645cdff3a6 req-74470266-83f4-4e34-b1f2-d9bcd1c4f7ca tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-fcc6c73a-a95e-4fa4-ba59-87645cdff3a6 req-74470266-83f4-4e34-b1f2-d9bcd1c4f7ca tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-fcc6c73a-a95e-4fa4-ba59-87645cdff3a6 req-74470266-83f4-4e34-b1f2-d9bcd1c4f7ca tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-fcc6c73a-a95e-4fa4-ba59-87645cdff3a6 req-74470266-83f4-4e34-b1f2-d9bcd1c4f7ca tempest-AttachVolumeNegativeTest-98167208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-29aff0b5-a2e5-446f-b1ba-832114e0851c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57a49a0d-72a3-48fa-beb8-afdabe9a71ef', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:24:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-fcc6c73a-a95e-4fa4-ba59-87645cdff3a6 req-74470266-83f4-4e34-b1f2-d9bcd1c4f7ca tempest-AttachVolumeNegativeTest-98167208 None] attachment_update completed successfully. Sep 22 18:24:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-d2ed8f84-9ed5-44f1-b625-b8d0ceb40eef req-0b0cfec1-917c-4d04-abce-3bb94cab9516 tempest-AttachVolumeNegativeTest-98167208 None] Terminate volume connection completed successfully. Sep 22 18:24:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-d2ed8f84-9ed5-44f1-b625-b8d0ceb40eef req-0b0cfec1-917c-4d04-abce-3bb94cab9516 tempest-AttachVolumeNegativeTest-98167208 None] Deleting attachment 57a49a0d-72a3-48fa-beb8-afdabe9a71ef. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Flow 'volume_create_manager' (5cdf28c9-d1c4-4d70-b7e6-fc50eb8bb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6f2de9-1416-4826-8065-8b5d8aca931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6f2de9-1416-4826-8065-8b5d8aca931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-252211575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be69090-30b0-43b3-a9bd-d3db025a1170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951305f98ef94a9980e4b73fafa4b034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:09Z,use_quota=True,user_id='040316e270554f688096ff871e32d3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348889e0-2637-42f8-8bc9-0ed07aa2a962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348889e0-2637-42f8-8bc9-0ed07aa2a962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5468fbce-4bb4-4115-9d28-a6079dc0c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5468fbce-4bb4-4115-9d28-a6079dc0c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be69090-30b0-43b3-a9bd-d3db025a1170', 'volume_name': 'volume-9be69090-30b0-43b3-a9bd-d3db025a1170', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db602da-8591-4cce-9862-6d9845246f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db602da-8591-4cce-9862-6d9845246f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b634b1-98a3-4c53-9a52-29b1714acf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Volume 9be69090-30b0-43b3-a9bd-d3db025a1170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be69090-30b0-43b3-a9bd-d3db025a1170', 'volume_size': 1} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-252211575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be69090-30b0-43b3-a9bd-d3db025a1170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951305f98ef94a9980e4b73fafa4b034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:09Z,use_quota=True,user_id='040316e270554f688096ff871e32d3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Creating volume 9be69090-30b0-43b3-a9bd-d3db025a1170 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:09 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:09 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 1073741824 Sep 22 18:24:09 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:10 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 1073741824" returned: 0 in 0.719s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:10 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 Sep 22 18:24:10 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (2d15f4d9-0891-4e18-a257-c673e2e1464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062e1437-fe7e-4e07-93d0-f6b5d8b8ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062e1437-fe7e-4e07-93d0-f6b5d8b8ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-63778880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53c3dbc-1418-4a8e-a045-7867e724b5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:11Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b6196-8e03-431c-9109-18c4a3dda582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b6196-8e03-431c-9109-18c4a3dda582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ed8b9-a8b3-4212-9d4e-b3b17d2da80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ed8b9-a8b3-4212-9d4e-b3b17d2da80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53c3dbc-1418-4a8e-a045-7867e724b5b3', 'volume_name': 'volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657a99af-5056-4e1a-8ae0-b383cb5936e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657a99af-5056-4e1a-8ae0-b383cb5936e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2617958-90e6-4bfd-aed0-dfda083293ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Volume e53c3dbc-1418-4a8e-a045-7867e724b5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3', 'volume_size': 1} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:10 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170" returned: 0 in 0.317s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-63778880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53c3dbc-1418-4a8e-a045-7867e724b5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:11Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Creating volume e53c3dbc-1418-4a8e-a045-7867e724b5b3 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:10 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:10 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 1073741824 Sep 22 18:24:10 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b634b1-98a3-4c53-9a52-29b1714acf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be69090-30b0-43b3-a9bd-d3db025a1170', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596b8ea3-8c70-4ac7-a3ab-5ea35cb3deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Volume volume-9be69090-30b0-43b3-a9bd-d3db025a1170 (9be69090-30b0-43b3-a9bd-d3db025a1170): created successfully Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596b8ea3-8c70-4ac7-a3ab-5ea35cb3deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Flow 'volume_create_manager' (5cdf28c9-d1c4-4d70-b7e6-fc50eb8bb73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2d3744dd-5c71-432d-b0b2-6b1fc521921b tempest-VolumesTransfersV355Test-1568539822 None] Created volume successfully. Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-29aff0b5-a2e5-446f-b1ba-832114e0851c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-29aff0b5-a2e5-446f-b1ba-832114e0851c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-quobyte-29aff0b5-a2e5-446f-b1ba-832114e0851c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-29aff0b5-a2e5-446f-b1ba-832114e0851c" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34e228-c561-4b4f-a236-3f94e208d95b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:11 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 1073741824" returned: 0 in 0.528s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:11 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c Sep 22 18:24:11 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:11 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 Sep 22 18:24:11 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:11 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3" returned: 0 in 0.315s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2617958-90e6-4bfd-aed0-dfda083293ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ff05b1-4284-45a0-8349-8ea764e39b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Volume volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 (e53c3dbc-1418-4a8e-a045-7867e724b5b3): created successfully Sep 22 18:24:11 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ff05b1-4284-45a0-8349-8ea764e39b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (2d15f4d9-0891-4e18-a257-c673e2e1464c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c" returned: 0 in 0.501s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:11 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c Sep 22 18:24:11 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-575cc2a1-6592-4d0a-bf46-baeed4b62d3d tempest-VolumesListAdminTestJSON-1282907906 None] Created volume successfully. Sep 22 18:24:12 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29aff0b5-a2e5-446f-b1ba-832114e0851c" returned: 0 in 0.346s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-29aff0b5-a2e5-446f-b1ba-832114e0851c" released by "delete_volume" :: held 0.906s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Created reservations ['7e205c37-4452-4de9-a818-0620ed2b1725', 'd83497d2-9296-4bd8-a6bb-60b5e86a8b99', 'd3faed43-8069-456a-bddc-63bc795f19e3', 'e862335c-e91c-48a9-a2b2-75e85b1f4ccc'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:12 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:12 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-19ee7f4b-3630-49fa-a56f-9b3c6c502397-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-19ee7f4b-3630-49fa-a56f-9b3c6c502397-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-quobyte-19ee7f4b-3630-49fa-a56f-9b3c6c502397" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-19ee7f4b-3630-49fa-a56f-9b3c6c502397" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f9b3c5d7-2a8e-4cdd-b071-e5039df8f121 tempest-VolumesTransfersV355Test-1485587251 None] Transfer volume completed successfully. Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b0689-535c-4e3f-a29c-b06df4682bb4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:12 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Deleted volume successfully. Sep 22 18:24:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8319d0ed-5ac1-458e-9ad8-523681ead4e2 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-29aff0b5-a2e5-446f-b1ba-832114e0851c-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:12 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 Sep 22 18:24:12 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:13 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397" returned: 0 in 0.529s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:13 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397 Sep 22 18:24:13 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "cinder-9be69090-30b0-43b3-a9bd-d3db025a1170-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-9be69090-30b0-43b3-a9bd-d3db025a1170-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "cinder-quobyte-9be69090-30b0-43b3-a9bd-d3db025a1170" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (152ffd2a-5ab2-4985-87e0-d11220c4956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c13cab5-a465-48af-b916-fc3199f27a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-quobyte-9be69090-30b0-43b3-a9bd-d3db025a1170" acquired by "delete_volume" :: waited 0.076s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:13 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-19ee7f4b-3630-49fa-a56f-9b3c6c502397" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3535641-057e-436a-92aa-68fe2f9c74fb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c13cab5-a465-48af-b916-fc3199f27a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952841647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c432cd-8ea1-46a8-884d-a195aa076b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:13Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246b13ea-80de-44f3-8c33-ff6d0f9094f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246b13ea-80de-44f3-8c33-ff6d0f9094f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0369c8d-c893-4b73-b64b-5cdcde685cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0369c8d-c893-4b73-b64b-5cdcde685cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c432cd-8ea1-46a8-884d-a195aa076b4c', 'volume_name': 'volume-70c432cd-8ea1-46a8-884d-a195aa076b4c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0c82f9-4951-43a7-a31a-e5981a2fdeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0c82f9-4951-43a7-a31a-e5981a2fdeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbcfd2d-f4b5-4487-87c8-f4b2f1294078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:13 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Volume 70c432cd-8ea1-46a8-884d-a195aa076b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c432cd-8ea1-46a8-884d-a195aa076b4c', 'volume_size': 1} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952841647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c432cd-8ea1-46a8-884d-a195aa076b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:13Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Creating volume 70c432cd-8ea1-46a8-884d-a195aa076b4c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:13 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-19ee7f4b-3630-49fa-a56f-9b3c6c502397" released by "delete_volume" :: held 1.050s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:13 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c 1073741824 Sep 22 18:24:13 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:13 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 Sep 22 18:24:13 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Created reservations ['7fbaa02f-c265-430c-b9a7-95385edfe4c0', 'e118f6d2-b3da-4f29-81e5-35cb9821c84f', 'efa89aca-ea68-40f1-80e2-a077b0cae580', '5307a6ad-aa32-45dc-a741-1eff7a23e479'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:13 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:13 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:13 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170" returned: 0 in 0.413s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:13 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170 Sep 22 18:24:13 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:14 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.315s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Deleted volume successfully. Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5109ffb1-e6df-4131-b945-36d94269566e tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-19ee7f4b-3630-49fa-a56f-9b3c6c502397-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:14 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c 1073741824" returned: 0 in 0.552s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:14 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c Sep 22 18:24:14 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:14 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9be69090-30b0-43b3-a9bd-d3db025a1170" returned: 0 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-quobyte-9be69090-30b0-43b3-a9bd-d3db025a1170" released by "delete_volume" :: held 0.789s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Created reservations ['f9c18f0f-e54f-4be7-9491-1bbc77b72984', 'fd9a0b16-613a-458e-aca9-8f558ea956ff', 'd06a6a76-a96f-4412-81d2-ab1ba6b32c14', '04bb035b-4acb-4b76-b824-34dbf289fc9e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:14 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:14 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:14 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbcfd2d-f4b5-4487-87c8-f4b2f1294078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c432cd-8ea1-46a8-884d-a195aa076b4c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f72111-04bd-4012-9fc4-a4ebb3c343a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:14 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Volume volume-70c432cd-8ea1-46a8-884d-a195aa076b4c (70c432cd-8ea1-46a8-884d-a195aa076b4c): created successfully Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f72111-04bd-4012-9fc4-a4ebb3c343a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (152ffd2a-5ab2-4985-87e0-d11220c4956b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dc439f5f-da88-4f16-997a-5bb511388c10 tempest-VolumesListAdminTestJSON-1282907906 None] Created volume successfully. Sep 22 18:24:14 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Deleted volume successfully. Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d4beacb4-df97-4844-a7ae-2033a1367db2 tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-9be69090-30b0-43b3-a9bd-d3db025a1170-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-94488d35-8cba-48f3-aed9-b9cacf3a058c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-94488d35-8cba-48f3-aed9-b9cacf3a058c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "cinder-quobyte-94488d35-8cba-48f3-aed9-b9cacf3a058c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-94488d35-8cba-48f3-aed9-b9cacf3a058c" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b9be6a-2f7d-4eed-bec2-25e9910c5253]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Flow 'volume_create_manager' (c9bf82ed-d9e9-496d-87fe-b505699b4033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:15 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c Sep 22 18:24:15 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6bb88b-738f-447f-b7fe-c880a365297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6bb88b-738f-447f-b7fe-c880a365297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-381216837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1526da3-a7c5-4916-bb89-f422f7f700ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951305f98ef94a9980e4b73fafa4b034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:15Z,use_quota=True,user_id='040316e270554f688096ff871e32d3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f76b51-4df5-489e-a15b-8139d24943e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f76b51-4df5-489e-a15b-8139d24943e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebb5812-30cf-4238-9324-714437a1f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebb5812-30cf-4238-9324-714437a1f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1526da3-a7c5-4916-bb89-f422f7f700ab', 'volume_name': 'volume-f1526da3-a7c5-4916-bb89-f422f7f700ab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1534a9d-ef0b-43e3-8de1-698e4f34d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1534a9d-ef0b-43e3-8de1-698e4f34d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0d18f2-64a4-4c79-adcc-3d164d18562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:15 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Volume f1526da3-a7c5-4916-bb89-f422f7f700ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1526da3-a7c5-4916-bb89-f422f7f700ab', 'volume_size': 1} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-381216837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1526da3-a7c5-4916-bb89-f422f7f700ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951305f98ef94a9980e4b73fafa4b034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:15Z,use_quota=True,user_id='040316e270554f688096ff871e32d3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Creating volume f1526da3-a7c5-4916-bb89-f422f7f700ab {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:15 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:15 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab 1073741824 Sep 22 18:24:15 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:15 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c" returned: 0 in 0.463s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:15 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c Sep 22 18:24:15 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:15 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-94488d35-8cba-48f3-aed9-b9cacf3a058c" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-quobyte-94488d35-8cba-48f3-aed9-b9cacf3a058c" released by "delete_volume" :: held 0.864s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:15 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab 1073741824" returned: 0 in 0.631s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Created reservations ['1b6e26b4-fde3-4a6f-940f-1e41b55b20f1', 'f17744fd-a877-4f4a-9fdf-453dcae9215c', '362a5458-725c-4e89-8d57-f509c27ade12', 'fc97e21f-729b-4fd2-839e-bbbe1eefc326'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:16 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab Sep 22 18:24:16 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:16 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:16 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:16 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (e2dba4dd-0ffd-4384-b3aa-95f2160ff78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee078c1-5fb9-4e93-9ac0-32c70f42a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee078c1-5fb9-4e93-9ac0-32c70f42a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1619854219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6efdff-162b-44f6-8399-4fcb68f09907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:16Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac645e5-89ea-419c-b773-de0d07b48860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac645e5-89ea-419c-b773-de0d07b48860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e86eac-788e-4d78-96ae-162d78eea53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e86eac-788e-4d78-96ae-162d78eea53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6efdff-162b-44f6-8399-4fcb68f09907', 'volume_name': 'volume-cb6efdff-162b-44f6-8399-4fcb68f09907', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53883e9-7ca4-4b79-90c3-b5816ca56bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53883e9-7ca4-4b79-90c3-b5816ca56bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0aced5-8ede-48de-8e3c-c31569be2fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Volume cb6efdff-162b-44f6-8399-4fcb68f09907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6efdff-162b-44f6-8399-4fcb68f09907', 'volume_size': 1} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1619854219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6efdff-162b-44f6-8399-4fcb68f09907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8a38c76b284a4fb235f1c19a77de6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:16Z,use_quota=True,user_id='53a87dfb484348499045ba1b914203c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Creating volume cb6efdff-162b-44f6-8399-4fcb68f09907 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:16 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0d18f2-64a4-4c79-adcc-3d164d18562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1526da3-a7c5-4916-bb89-f422f7f700ab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dc6f66-415f-44af-8711-b1f46ed0080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:16 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 1073741824 Sep 22 18:24:16 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Volume volume-f1526da3-a7c5-4916-bb89-f422f7f700ab (f1526da3-a7c5-4916-bb89-f422f7f700ab): created successfully Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dc6f66-415f-44af-8711-b1f46ed0080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Flow 'volume_create_manager' (c9bf82ed-d9e9-496d-87fe-b505699b4033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4958100c-e929-42a5-935b-24e4b0df4f7e tempest-VolumesTransfersV355Test-1568539822 None] Created volume successfully. Sep 22 18:24:16 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.425s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Deleted volume successfully. Sep 22 18:24:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0be5b69-4080-489a-a14c-4245302cc109 tempest-AttachVolumeNegativeTest-98167208 None] Lock "cinder-94488d35-8cba-48f3-aed9-b9cacf3a058c-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:17 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 1073741824" returned: 0 in 0.653s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:17 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 Sep 22 18:24:17 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:17 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907" returned: 0 in 0.540s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0aced5-8ede-48de-8e3c-c31569be2fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6efdff-162b-44f6-8399-4fcb68f09907', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ce0a4e-d578-45ce-88d0-d159accf9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:17 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Volume volume-cb6efdff-162b-44f6-8399-4fcb68f09907 (cb6efdff-162b-44f6-8399-4fcb68f09907): created successfully Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ce0a4e-d578-45ce-88d0-d159accf9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Flow 'volume_create_manager' (e2dba4dd-0ffd-4384-b3aa-95f2160ff78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-31ee4f33-b40f-42cc-a5a7-39550dfdbbcf tempest-VolumesListAdminTestJSON-1282907906 None] Created volume successfully. Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "cinder-f1526da3-a7c5-4916-bb89-f422f7f700ab-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-f1526da3-a7c5-4916-bb89-f422f7f700ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "cinder-quobyte-f1526da3-a7c5-4916-bb89-f422f7f700ab" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-quobyte-f1526da3-a7c5-4916-bb89-f422f7f700ab" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[535203ab-0593-42c4-855a-761b9ef85b2b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:18 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab Sep 22 18:24:18 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:18 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab" returned: 0 in 0.454s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:18 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab Sep 22 18:24:18 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:18 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f1526da3-a7c5-4916-bb89-f422f7f700ab" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-quobyte-f1526da3-a7c5-4916-bb89-f422f7f700ab" released by "delete_volume" :: held 0.881s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Created reservations ['050528f5-d52f-4c0c-bb07-b8433a4c9b90', 'efedae59-7c19-4147-a6a4-217b54374c48', 'b4eb7d2a-7d13-4a05-b2e4-79045c22bd84', '0e5f1517-5e14-4da5-a36b-863d6d2014d3'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:19 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:19 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:19 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Flow 'volume_create_manager' (0e9f0b7f-4f82-4583-b75f-8c52cea9323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140c340b-8784-470c-8d7d-fe40084ebae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140c340b-8784-470c-8d7d-fe40084ebae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d336477e-33d9-45d9-b853-e7a002f9e82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1071a1aec406ca61126c6ab71d7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:19Z,use_quota=True,user_id='599dfb7f4196482191bcadd920d1134d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb89c7d-0910-47f5-b046-f4b6f85b9121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb89c7d-0910-47f5-b046-f4b6f85b9121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6deef75-a43b-449e-b812-ea181d06fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6deef75-a43b-449e-b812-ea181d06fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd336477e-33d9-45d9-b853-e7a002f9e82e', 'volume_name': 'volume-d336477e-33d9-45d9-b853-e7a002f9e82e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f9806a-72a9-4355-810d-fdd38c69644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f9806a-72a9-4355-810d-fdd38c69644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2badf5e5-bf6c-4c3e-859b-28e2a6baae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:19 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Volume d336477e-33d9-45d9-b853-e7a002f9e82e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d336477e-33d9-45d9-b853-e7a002f9e82e', 'volume_size': 1} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d336477e-33d9-45d9-b853-e7a002f9e82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1071a1aec406ca61126c6ab71d7f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:19Z,use_quota=True,user_id='599dfb7f4196482191bcadd920d1134d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Creating volume d336477e-33d9-45d9-b853-e7a002f9e82e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:19 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Deleted volume successfully. Sep 22 18:24:19 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e 1073741824 Sep 22 18:24:19 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-42167985-feb5-4298-a9c9-e68b20c418bc tempest-VolumesTransfersV355Test-834840063 None] Lock "cinder-f1526da3-a7c5-4916-bb89-f422f7f700ab-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:20 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e 1073741824" returned: 0 in 0.694s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:20 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e Sep 22 18:24:20 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:20 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e" returned: 0 in 0.415s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2badf5e5-bf6c-4c3e-859b-28e2a6baae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d336477e-33d9-45d9-b853-e7a002f9e82e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5129b806-b14b-435d-b976-40900075298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Volume volume-d336477e-33d9-45d9-b853-e7a002f9e82e (d336477e-33d9-45d9-b853-e7a002f9e82e): created successfully Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5129b806-b14b-435d-b976-40900075298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Flow 'volume_create_manager' (0e9f0b7f-4f82-4583-b75f-8c52cea9323e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1d0feb40-2ed7-4bd4-9531-7c7a4195c65b tempest-VolumesListAdminTestJSON-742645001 None] Created volume successfully. Sep 22 18:24:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Acquiring lock "cinder-d336477e-33d9-45d9-b853-e7a002f9e82e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "cinder-d336477e-33d9-45d9-b853-e7a002f9e82e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Acquiring lock "cinder-quobyte-d336477e-33d9-45d9-b853-e7a002f9e82e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "cinder-quobyte-d336477e-33d9-45d9-b853-e7a002f9e82e" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a571b687-7c98-42c3-8ca9-d5cfae229046]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-cb6efdff-162b-44f6-8399-4fcb68f09907-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-cb6efdff-162b-44f6-8399-4fcb68f09907-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:22 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e Sep 22 18:24:22 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-quobyte-cb6efdff-162b-44f6-8399-4fcb68f09907" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-cb6efdff-162b-44f6-8399-4fcb68f09907" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db910d-a940-43af-b839-75330d8dfbc8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:22 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 Sep 22 18:24:22 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:23 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e" returned: 0 in 0.949s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:23 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e Sep 22 18:24:23 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:23 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907" returned: 0 in 0.861s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:23 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907 Sep 22 18:24:23 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:23 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d336477e-33d9-45d9-b853-e7a002f9e82e" returned: 0 in 0.578s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "cinder-quobyte-d336477e-33d9-45d9-b853-e7a002f9e82e" released by "delete_volume" :: held 1.630s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Created reservations ['17ea791c-f501-4a4c-8d54-feebf5ea1b10', '7aa71cbe-ce2c-48c0-a2d6-7cead584a706', '5636dddd-b3ba-476a-94c4-1a0d843150bf', '03fbcd9c-66df-4141-820e-fa70939899a4'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:23 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:23 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:24 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cb6efdff-162b-44f6-8399-4fcb68f09907" returned: 0 in 0.669s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-cb6efdff-162b-44f6-8399-4fcb68f09907" released by "delete_volume" :: held 1.629s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Created reservations ['345d9588-bc01-42ff-aa58-8d468b8e85bf', '4107b180-6898-4600-bc23-5f117388e9ab', 'a5ed29e0-4500-4320-95a4-5fbc400e2e9d', '588163e8-f0da-4436-9cf3-161759804a0b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:24 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.442s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Deleted volume successfully. Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-425b5281-4175-4e97-8040-420ac22cc6fa tempest-VolumesListAdminTestJSON-742645001 None] Lock "cinder-d336477e-33d9-45d9-b853-e7a002f9e82e-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:24 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:24 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:24 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.463s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Deleted volume successfully. Sep 22 18:24:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9f75bad5-845c-444b-88d9-cec659976bb8 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-cb6efdff-162b-44f6-8399-4fcb68f09907-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-70c432cd-8ea1-46a8-884d-a195aa076b4c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-70c432cd-8ea1-46a8-884d-a195aa076b4c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-quobyte-70c432cd-8ea1-46a8-884d-a195aa076b4c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-70c432cd-8ea1-46a8-884d-a195aa076b4c" acquired by "delete_volume" :: waited 0.037s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a37ae9-fb45-4d48-a81b-27b2f307187b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:25 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c Sep 22 18:24:25 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:25 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c" returned: 0 in 0.647s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:26 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c Sep 22 18:24:26 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:26 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-70c432cd-8ea1-46a8-884d-a195aa076b4c" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-70c432cd-8ea1-46a8-884d-a195aa076b4c" released by "delete_volume" :: held 1.134s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Created reservations ['92963039-3a23-41aa-9545-0e88198c612a', '7b378aec-5514-4eba-90c6-39d40ab0583f', 'c9e69a23-5764-46f7-a422-4ce739738f7a', '95a75fac-d637-40e8-9251-1b714a75aa63'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:26 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:26 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:26 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:26 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Deleted volume successfully. Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-becefd6a-b047-46e7-b306-eed9e4d80fdb tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-70c432cd-8ea1-46a8-884d-a195aa076b4c-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-e53c3dbc-1418-4a8e-a045-7867e724b5b3-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-e53c3dbc-1418-4a8e-a045-7867e724b5b3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "cinder-quobyte-e53c3dbc-1418-4a8e-a045-7867e724b5b3" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-e53c3dbc-1418-4a8e-a045-7867e724b5b3" acquired by "delete_volume" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5971582-3ca1-4281-ae71-98a20ed755d3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:28 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 Sep 22 18:24:28 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:28 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3" returned: 0 in 0.555s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:28 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3 Sep 22 18:24:28 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:28 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e53c3dbc-1418-4a8e-a045-7867e724b5b3" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-quobyte-e53c3dbc-1418-4a8e-a045-7867e724b5b3" released by "delete_volume" :: held 0.981s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Created reservations ['e970474d-7249-430e-8fd0-f87ae9a84ff9', '3ef150e7-f815-4463-840f-9db01bf30896', '41c5c82f-1c78-4b91-9d99-4d3a1fa21bad', '27d27cf7-66e4-41fd-9d09-6b21ffcce3cb'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:29 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:29 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:29 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.348s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Deleted volume successfully. Sep 22 18:24:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccdcb7bb-585e-4030-8b53-5d6bb4213201 tempest-VolumesListAdminTestJSON-1282907906 None] Lock "cinder-e53c3dbc-1418-4a8e-a045-7867e724b5b3-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Flow 'volume_create_manager' (a46a110a-d091-4e4c-b4fe-086011711bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869adaa4-5995-4195-860a-4922791fbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869adaa4-5995-4195-860a-4922791fbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-641962563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158630ac-9899-4b0c-8394-8cf7f409d1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f807dc26a534812b054615d5ee60631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:31Z,use_quota=True,user_id='730fcd88029d48e4a77e59915a269b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890c3b0e-a312-4b79-b22b-ada4076d7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890c3b0e-a312-4b79-b22b-ada4076d7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f7318-05bd-404d-ad6c-e13b6f890b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f7318-05bd-404d-ad6c-e13b6f890b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158630ac-9899-4b0c-8394-8cf7f409d1d4', 'volume_name': 'volume-158630ac-9899-4b0c-8394-8cf7f409d1d4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b73718-1a74-46e4-acf9-88681449c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b73718-1a74-46e4-acf9-88681449c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047188a-e497-48b6-beeb-fb9fab3b2963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:31 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Volume 158630ac-9899-4b0c-8394-8cf7f409d1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158630ac-9899-4b0c-8394-8cf7f409d1d4', 'volume_size': 1} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-641962563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158630ac-9899-4b0c-8394-8cf7f409d1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f807dc26a534812b054615d5ee60631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:31Z,use_quota=True,user_id='730fcd88029d48e4a77e59915a269b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Creating volume 158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:31 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:31 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 1073741824 Sep 22 18:24:31 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=159,cinder:SELECT=114,cinder:INSERT=38,cinder:DELETE=13 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:24:32 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 1073741824" returned: 0 in 0.769s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=124,cinder:UPDATE=165,cinder:INSERT=36,cinder:DELETE=12 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:24:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c8907976-550e-4ba3-beeb-e8ff07679475 tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-1428828657: creating Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:32 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:32 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c8907976-550e-4ba3-beeb-e8ff07679475 tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-1428828657: created successfully Sep 22 18:24:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c8907976-550e-4ba3-beeb-e8ff07679475 tempest-GroupSnapshotsTest-1331466253 None] Create group completed successfully. Sep 22 18:24:32 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.291s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047188a-e497-48b6-beeb-fb9fab3b2963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158630ac-9899-4b0c-8394-8cf7f409d1d4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e3f6b-2df2-451d-ac57-a3948c872dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:32 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Volume volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 (158630ac-9899-4b0c-8394-8cf7f409d1d4): created successfully Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e3f6b-2df2-451d-ac57-a3948c872dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Flow 'volume_create_manager' (a46a110a-d091-4e4c-b4fe-086011711bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1b81a561-a269-4cce-b4c5-0b2e520fec0b tempest-VolumesCloneTest-1524344349 None] Created volume successfully. Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (7db78fdc-e768-40f6-aae9-d6cd16d2a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d126d8df-6001-4d55-b542-31bd20d93e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d126d8df-6001-4d55-b542-31bd20d93e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602070760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12999513-1e56-464f-94bb-0cd7846de4e9,host='devstack@QuobyteHD#QuobyteHD',id=3847bcf4-5b3a-4b97-88df-76888eeef7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:34Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885e11ce-9709-4d3c-84ed-f8d4daec21b8),volume_type_id=885e11ce-9709-4d3c-84ed-f8d4daec21b8)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c2895d-6d07-44a7-a077-97a843febc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c2895d-6d07-44a7-a077-97a843febc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe61e409-d469-4404-977d-5f0ef4f347b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe61e409-d469-4404-977d-5f0ef4f347b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3847bcf4-5b3a-4b97-88df-76888eeef7bd', 'volume_name': 'volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4234654-8c71-4329-8a46-8740f21e670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4234654-8c71-4329-8a46-8740f21e670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556caeff-d6f6-47d1-a08f-69170fa80a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Volume 3847bcf4-5b3a-4b97-88df-76888eeef7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd', 'volume_size': 1} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12999513-1e56-464f-94bb-0cd7846de4e9,created_at=2026-09-22T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602070760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12999513-1e56-464f-94bb-0cd7846de4e9,host='devstack@QuobyteHD#QuobyteHD',id=3847bcf4-5b3a-4b97-88df-76888eeef7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:34Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885e11ce-9709-4d3c-84ed-f8d4daec21b8),volume_type_id=885e11ce-9709-4d3c-84ed-f8d4daec21b8)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Creating volume 3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:34 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:34 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd 1073741824 Sep 22 18:24:34 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Flow 'volume_create_manager' (a14c3c01-07dc-42e6-b86e-6bc847ec6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c3c61-67ff-402c-9ec8-05e6353a137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c3c61-67ff-402c-9ec8-05e6353a137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1045795107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37f0127-9040-407c-ac4c-4fe57bb617b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f807dc26a534812b054615d5ee60631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=158630ac-9899-4b0c-8394-8cf7f409d1d4,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:34Z,use_quota=True,user_id='730fcd88029d48e4a77e59915a269b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c238599-8bbe-4a7f-ae4a-9ee477fd4f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c238599-8bbe-4a7f-ae4a-9ee477fd4f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec3415c-3450-4302-aecf-3ce912e053f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec3415c-3450-4302-aecf-3ce912e053f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e37f0127-9040-407c-ac4c-4fe57bb617b5', 'volume_name': 'volume-e37f0127-9040-407c-ac4c-4fe57bb617b5', 'volume_size': 2, 'source_volid': '158630ac-9899-4b0c-8394-8cf7f409d1d4', 'source_volstatus': 'available'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51339684-906b-4750-bbaa-1d52402387a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51339684-906b-4750-bbaa-1d52402387a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4669b5c5-538e-49cd-bd06-4d34c62e40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Volume e37f0127-9040-407c-ac4c-4fe57bb617b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e37f0127-9040-407c-ac4c-4fe57bb617b5', 'volume_size': 2, 'source_volid': '158630ac-9899-4b0c-8394-8cf7f409d1d4', 'source_volstatus': 'available'} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:34 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd 1073741824" returned: 0 in 0.538s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:34 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:24:34 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:35 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.612s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:35 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Cloning volume 158630ac-9899-4b0c-8394-8cf7f409d1d4 to volume e37f0127-9040-407c-ac4c-4fe57bb617b5 Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556caeff-d6f6-47d1-a08f-69170fa80a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759516e-0a40-4a73-833e-04a46a4e7d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Volume volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd (3847bcf4-5b3a-4b97-88df-76888eeef7bd): created successfully Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759516e-0a40-4a73-833e-04a46a4e7d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (7db78fdc-e768-40f6-aae9-d6cd16d2a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Creating offline snapshot 053e2372-81b2-459b-92d6-f0e34faa9511 of volume 158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:24:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b0ee0dbe-62e1-4635-a291-3386d7cf7e93 tempest-GroupSnapshotsTest-1331466253 None] Created volume successfully. Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d9305-1fb7-4705-823c-4083b2ecb17a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:35 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:35 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] GroupSnapshot 2c89299e-0335-44e6-b8a1-408154544ef0: creating. Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Group snapshot 2c89299e-0335-44e6-b8a1-408154544ef0: creating. {{(pid=86046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:35 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.586s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:35 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 1G Sep 22 18:24:35 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:36 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 1G" returned: 0 in 0.459s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:36 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:36 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:36 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.296s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:36 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 is being set with open permissions: ugo+rw Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:36 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:36 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:36 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:36 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info Sep 22 18:24:36 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:37 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:37 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info is being set with open permissions: ugo+rw Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:37 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info Sep 22 18:24:37 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:37 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.info" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] snapshot: 053e2372-81b2-459b-92d6-f0e34faa9511, volume: e37f0127-9040-407c-ac4c-4fe57bb617b5, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c2a402-16c0-4dee-90a3-f6c5a6d9f8de]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:37 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:37 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:37 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.428s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-158630ac-9899-4b0c-8394-8cf7f409d1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:24:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8769ae-ea12-4f85-954d-e12466147b27]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:38 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:38 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:38 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:24:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:38 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 Sep 22 18:24:38 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Flow 'volume_create_manager' (d35a30dc-599a-4941-98f2-c15b0b4c9f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5690ef4c-e1db-4f40-be56-f4532e19f07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5690ef4c-e1db-4f40-be56-f4532e19f07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1847941810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57db7116-a784-4524-8367-5c6f40ae26fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b27e94398fb4c1c9c93f1a88ab9c1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:42Z,use_quota=True,user_id='4f1047895489473f83326f6bb9050499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2662bd7-36d8-4405-af0d-994c6f73b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2662bd7-36d8-4405-af0d-994c6f73b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186545c0-0823-462c-abb4-65741392de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:41 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:24:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186545c0-0823-462c-abb4-65741392de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57db7116-a784-4524-8367-5c6f40ae26fd', 'volume_name': 'volume-57db7116-a784-4524-8367-5c6f40ae26fd', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f734b834-28ba-43ea-b9ab-20f51cecc272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f734b834-28ba-43ea-b9ab-20f51cecc272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9fce36-adac-4deb-8c13-5d07892947ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:42 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Volume 57db7116-a784-4524-8367-5c6f40ae26fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57db7116-a784-4524-8367-5c6f40ae26fd', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 18:24:42 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Trying to clone 57db7116-a784-4524-8367-5c6f40ae26fd from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:24:43 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD, size 20.69 MB, duration 1.05 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:24:43 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Image download 20.69 MB at 19.66 MB/s Sep 22 18:24:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b0000-a95c-45bb-903b-d4c27436704e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:43 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD Sep 22 18:24:43 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:44 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:44 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 is fetched for user 4f1047895489473f83326f6bb9050499. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:24:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400ed90-5552-4bf9-9397-e7ef5c184a48]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:44 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD Sep 22 18:24:44 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:45 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:45 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5" returned: 0 in 7.434s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:45 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:24:45 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Converted 1024.00 MB image at 137.72 MB/s Sep 22 18:24:45 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 is being set with open permissions: ugo+rw Sep 22 18:24:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:45 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 Sep 22 18:24:45 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:46 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5" returned: 0 in 0.230s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" released by "_copy_volume_from_snapshot" :: held 8.558s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-quobyte-053e2372-81b2-459b-92d6-f0e34faa9511" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-053e2372-81b2-459b-92d6-f0e34faa9511" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Deleting offline snapshot 053e2372-81b2-459b-92d6-f0e34faa9511 of volume 158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] snapshot_file for this snap is: volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb2b275-59b9-4309-9269-2bb85923e8f0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:46 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:46 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:46 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.350s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-158630ac-9899-4b0c-8394-8cf7f409d1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ebb67-045c-4e3d-a658-07a4b248b508]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:46 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:46 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:47 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.535s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:47 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:47 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (209c0947-cfc3-4ff4-8fe7-fa7e0a014542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40afb7bc-6f2d-4509-8c5c-1232f0f46c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40afb7bc-6f2d-4509-8c5c-1232f0f46c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1437198559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:47Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23296d02-347b-47ec-8cdf-9fc1727ebf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23296d02-347b-47ec-8cdf-9fc1727ebf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c5fa2-eb0d-4873-8cbf-b5e945896afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7c5fa2-eb0d-4873-8cbf-b5e945896afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5', 'volume_name': 'volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c54192-0a2d-4c90-91f7-4db5ef067c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c54192-0a2d-4c90-91f7-4db5ef067c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5de76d-fb2d-491e-9b28-de8aa74859b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Volume 1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5', 'volume_size': 1} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:47 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.334s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:47 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511 Sep 22 18:24:47 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:47 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4.053e2372-81b2-459b-92d6-f0e34faa9511" returned: 0 in 0.240s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-053e2372-81b2-459b-92d6-f0e34faa9511" released by "_delete_snapshot" :: held 1.557s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.513s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.814s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4669b5c5-538e-49cd-bd06-4d34c62e40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37f0127-9040-407c-ac4c-4fe57bb617b5', 'volume_size': 2, 'source_volid': '158630ac-9899-4b0c-8394-8cf7f409d1d4', 'source_volstatus': 'available'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b543a79-59db-4c0c-80e8-62bf10581601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Creating offline snapshot 8fed8f5e-76a5-4008-9d96-cea427cce350 of volume 3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:24:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Volume volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 (e37f0127-9040-407c-ac4c-4fe57bb617b5): created successfully Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b543a79-59db-4c0c-80e8-62bf10581601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Flow 'volume_create_manager' (a14c3c01-07dc-42e6-b86e-6bc847ec6f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd88ad8-e9af-4bfd-9f46-3d02a1b196c9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:47 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7c4dd215-8182-41dc-9e6e-950c4be88b6f tempest-VolumesCloneTest-1524344349 None] Created volume successfully. Sep 22 18:24:47 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:24:47 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:48 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:48 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 1G Sep 22 18:24:48 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:48 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 1G" returned: 0 in 0.418s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:48 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:48 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:48 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:24:48 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:48 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-e37f0127-9040-407c-ac4c-4fe57bb617b5-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-e37f0127-9040-407c-ac4c-4fe57bb617b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:48 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.335s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:48 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:48 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:24:48 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc02dcd-d90d-46c1-a971-ea8b52b5f420]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 Sep 22 18:24:49 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info Sep 22 18:24:49 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5" returned: 0 in 0.389s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5 Sep 22 18:24:49 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:49 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info Sep 22 18:24:49 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e37f0127-9040-407c-ac4c-4fe57bb617b5" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-e37f0127-9040-407c-ac4c-4fe57bb617b5" released by "delete_volume" :: held 0.700s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Created reservations ['4ac655cc-71e1-481e-85f9-335d970755a6', '11a2aef2-d32f-4c19-abc4-e6c92aabc237', 'c659abb8-c7ae-4985-8fbf-62ba5ffb5a59', 'b2fe1d1f-5c3c-4771-8cb5-0c3f5b2e7466'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:49 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.info" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.665s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1847941810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57db7116-a784-4524-8367-5c6f40ae26fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b27e94398fb4c1c9c93f1a88ab9c1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:42Z,use_quota=True,user_id='4f1047895489473f83326f6bb9050499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Creating volume 57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:49 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1073741824 Sep 22 18:24:49 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:49 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:49 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e37b6d0e-4245-4075-b28d-ff25e00365fa tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 2c89299e-0335-44e6-b8a1-408154544ef0: created successfully Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-158630ac-9899-4b0c-8394-8cf7f409d1d4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-158630ac-9899-4b0c-8394-8cf7f409d1d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:50 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Deleted volume successfully. Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "cinder-quobyte-158630ac-9899-4b0c-8394-8cf7f409d1d4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21e2eec1-bf87-4a5b-b388-de383df295e4 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-e37f0127-9040-407c-ac4c-4fe57bb617b5-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-158630ac-9899-4b0c-8394-8cf7f409d1d4" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a934b63-f6e2-45ed-9a00-8e6dc19b8cc1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:50 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1073741824" returned: 0 in 0.527s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:50 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd Sep 22 18:24:50 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:50 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:50 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:50 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1437198559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:47Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Creating volume 1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:50 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:50 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 1073741824 Sep 22 18:24:50 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:50 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.400s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Attempting download of 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 57db7116-a784-4524-8367-5c6f40ae26fd. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:24:50 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4 Sep 22 18:24:50 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba0d17-35e0-44bb-836b-64fdbeba2117]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:50 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke Sep 22 18:24:50 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:50 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-158630ac-9899-4b0c-8394-8cf7f409d1d4" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-quobyte-158630ac-9899-4b0c-8394-8cf7f409d1d4" released by "delete_volume" :: held 0.774s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Created reservations ['37a572b3-d8bf-4a70-8bca-b77747cc8973', '4283e4ca-7636-4d0a-bf4c-921936fef9b6', 'bd8f2a88-f3ce-4f52-ae65-75da663a9227', 'dd924882-3293-467f-8342-c70819652206'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:51 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke" returned: 0 in 0.402s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:51 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:51 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:51 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 1073741824" returned: 0 in 0.654s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:51 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke Sep 22 18:24:51 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:51 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 Sep 22 18:24:51 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:51 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.437s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:24:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Deleted volume successfully. Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1d53ec34-9b6b-4026-a9dc-3d00da863ac5 tempest-VolumesCloneTest-1524344349 None] Lock "cinder-158630ac-9899-4b0c-8394-8cf7f409d1d4-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:51 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke" returned: 1 in 0.504s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_qx66btke' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe67cd-1bed-4ed7-a64f-bc46b858cce1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:51 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350-b17997be-fc02-4ec6-ae1b-5ba13baa3349" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:51 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5de76d-fb2d-491e-9b28-de8aa74859b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:51 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712f8cc7-501d-4992-8c81-996083ef3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350-b17997be-fc02-4ec6-ae1b-5ba13baa3349" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Creating volume b17997be-fc02-4ec6-ae1b-5ba13baa3349 from snapshot 8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Volume volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 (1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5): created successfully Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712f8cc7-501d-4992-8c81-996083ef3e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (209c0947-cfc3-4ff4-8fe7-fa7e0a014542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] snapshot: 8fed8f5e-76a5-4008-9d96-cea427cce350, volume: b17997be-fc02-4ec6-ae1b-5ba13baa3349, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:24:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f1b478ec-4f05-4fa3-9d48-34e856c713a9 tempest-AttachVolumeTestJSON-1243952890 None] Created volume successfully. Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b939ec7-e321-437d-a1f7-afc1fa018d2d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:52 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:24:52 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:24:52 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:52 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd Sep 22 18:24:52 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:52 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.425s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4afc8-4776-42ef-8ab4-b61d204e1f7b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:52 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:24:52 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:52 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.546s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:24:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:52 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 Sep 22 18:24:52 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a470dbe3-d886-4e28-adb4-60b043b42138 req-8a8de04f-353c-4499-84e4-dd264fbf1466 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:55 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd" returned: 0 in 3.755s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:55 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_hl_7pq54devstack@QuobyteHD, size 112.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:24:55 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Converted 112.00 MB image at 29.81 MB/s Sep 22 18:24:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:55 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1G Sep 22 18:24:55 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:56 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd 1G" returned: 0 in 0.868s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Downloaded image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 57db7116-a784-4524-8367-5c6f40ae26fd successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 for user 4f1047895489473f83326f6bb9050499 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Marking volume 57db7116-a784-4524-8367-5c6f40ae26fd as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Copying metadata from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 to 57db7116-a784-4524-8367-5c6f40ae26fd. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Creating volume glance metadata for volume 57db7116-a784-4524-8367-5c6f40ae26fd backed by image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9fce36-adac-4deb-8c13-5d07892947ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57db7116-a784-4524-8367-5c6f40ae26fd', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93000061-13e9-4853-84f9-bd96177b9671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Volume volume-57db7116-a784-4524-8367-5c6f40ae26fd (57db7116-a784-4524-8367-5c6f40ae26fd): created successfully Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93000061-13e9-4853-84f9-bd96177b9671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Flow 'volume_create_manager' (d35a30dc-599a-4941-98f2-c15b0b4c9f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ea31592c-7246-4e63-af74-0d991914e0ce tempest-VolumesImageMetadata-1831470572 None] Created volume successfully. Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Flow 'volume_create_manager' (b52199ad-4674-4e22-9b7d-26cbb98fa699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8f991-e90a-40c3-b6b8-3ffa396ce07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8f991-e90a-40c3-b6b8-3ffa396ce07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-682601045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022f40fb-3b6f-4169-b751-752bacb2c270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2bef96c60447abba51faf7d84696c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:57Z,use_quota=True,user_id='55c7a7a1af564639873b1cbfa9946609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2427e875-b88b-49c7-bc0d-42954a25ca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2427e875-b88b-49c7-bc0d-42954a25ca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e36ed7d-0632-4f60-a042-b7e75c9d96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e36ed7d-0632-4f60-a042-b7e75c9d96a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022f40fb-3b6f-4169-b751-752bacb2c270', 'volume_name': 'volume-022f40fb-3b6f-4169-b751-752bacb2c270', 'volume_size': 2}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279acce5-ee62-4f40-a0d7-8b0ea51630a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279acce5-ee62-4f40-a0d7-8b0ea51630a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2d909a-f337-4ed9-8c45-d0e2fde6f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:24:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Volume 022f40fb-3b6f-4169-b751-752bacb2c270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022f40fb-3b6f-4169-b751-752bacb2c270', 'volume_size': 2} Sep 22 18:24:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Acquiring lock "cinder-57db7116-a784-4524-8367-5c6f40ae26fd-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "cinder-57db7116-a784-4524-8367-5c6f40ae26fd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Acquiring lock "cinder-quobyte-57db7116-a784-4524-8367-5c6f40ae26fd" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "cinder-quobyte-57db7116-a784-4524-8367-5c6f40ae26fd" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9516de0-babc-4653-81a4-d366a757c72d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:24:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:58 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd Sep 22 18:24:58 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:59 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd" returned: 0 in 0.561s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:59 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd Sep 22 18:24:59 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:24:59 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-57db7116-a784-4524-8367-5c6f40ae26fd" returned: 0 in 0.496s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "cinder-quobyte-57db7116-a784-4524-8367-5c6f40ae26fd" released by "delete_volume" :: held 1.149s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Created reservations ['9d93111e-e3f8-4527-a255-d7058fe05f80', '25f3a16f-b90f-4a83-8d29-35958ddb167f', 'b3fbf3ec-3a0e-4d81-b7c6-b2b48a0f0572', '70a3dbfe-96e7-406d-87a2-6ec6e2fe01c8'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:24:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:24:59 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:24:59 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:00 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Deleted volume successfully. Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dc573f71-9990-4d93-85d1-e0201f500b5b tempest-VolumesImageMetadata-1831470572 None] Lock "cinder-57db7116-a784-4524-8367-5c6f40ae26fd-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:00 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349" returned: 0 in 7.598s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:25:00 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Converted 1024.00 MB image at 134.75 MB/s Sep 22 18:25:00 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:00 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 Sep 22 18:25:00 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:00 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" released by "_copy_volume_from_snapshot" :: held 8.943s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350-b17997be-fc02-4ec6-ae1b-5ba13baa3349" released by "_create_volume_from_snapshot" :: held 9.067s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.123s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a470dbe3-d886-4e28-adb4-60b043b42138 req-8a8de04f-353c-4499-84e4-dd264fbf1466 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.601s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a470dbe3-d886-4e28-adb4-60b043b42138 req-8a8de04f-353c-4499-84e4-dd264fbf1466 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-682601045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022f40fb-3b6f-4169-b751-752bacb2c270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2bef96c60447abba51faf7d84696c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:24:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:24:57Z,use_quota=True,user_id='55c7a7a1af564639873b1cbfa9946609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Creating volume 022f40fb-3b6f-4169-b751-752bacb2c270 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:00 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 2147483648 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:00 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 2147483648 Sep 22 18:25:00 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-a470dbe3-d886-4e28-adb4-60b043b42138 req-8a8de04f-353c-4499-84e4-dd264fbf1466 tempest-AttachVolumeTestJSON-1243952890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '781dfee5-c086-4ed9-88c1-aa2cce883494', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:25:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-80eb6b98-03c8-44a5-a27b-4421b46ec98b tempest-GroupSnapshotsTest-1331466253 None] Create group from source-snapshot-2c89299e-0335-44e6-b8a1-408154544ef0 completed successfully. Sep 22 18:25:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-a470dbe3-d886-4e28-adb4-60b043b42138 req-8a8de04f-353c-4499-84e4-dd264fbf1466 tempest-AttachVolumeTestJSON-1243952890 None] attachment_update completed successfully. Sep 22 18:25:01 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 2147483648" returned: 0 in 0.763s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:01 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 Sep 22 18:25:01 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26da72-afd7-4987-bd46-2c1df8e468d1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:02 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 Sep 22 18:25:02 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:02 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270" returned: 0 in 0.541s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2d909a-f337-4ed9-8c45-d0e2fde6f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022f40fb-3b6f-4169-b751-752bacb2c270', 'volume_size': 2}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d017b8-83f0-42c6-bb94-d191a394f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Volume volume-022f40fb-3b6f-4169-b751-752bacb2c270 (022f40fb-3b6f-4169-b751-752bacb2c270): created successfully Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d017b8-83f0-42c6-bb94-d191a394f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Flow 'volume_create_manager' (b52199ad-4674-4e22-9b7d-26cbb98fa699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8ff1477d-f55b-45b0-a927-9d1c7b453247 tempest-VolumesCloneNegativeTest-1909210911 None] Created volume successfully. Sep 22 18:25:02 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349" returned: 0 in 0.509s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:02 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349 Sep 22 18:25:02 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:02 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b17997be-fc02-4ec6-ae1b-5ba13baa3349" returned: 0 in 0.251s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-b17997be-fc02-4ec6-ae1b-5ba13baa3349" released by "delete_volume" :: held 0.854s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['c8dfde4a-35c8-4610-867d-24e362429849'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:02 devstack cinder-volume[86046]: WARNING cinder.quota [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1040785301 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1040785301, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:02 devstack cinder-volume[86046]: WARNING cinder.quota [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1040785301 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1040785301, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:02 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['5ab1a8da-4988-4fb1-9f10-3723c34b6bad', '1f3b1b9a-56cc-4564-9678-4f973c7cbc8c', '0327f0fa-f624-4ed9-9ceb-67bb88d1d311', '76d6095e-1d7d-4a89-a00e-84f3330a3923'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:03 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:03 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:03 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.271s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-24870234-5ccd-4f56-a9d7-ccef5e78bc9a tempest-GroupSnapshotsTest-1331466253 None] Delete group completed successfully. Sep 22 18:25:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 2c89299e-0335-44e6-b8a1-408154544ef0: deleting Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 2c89299e-0335-44e6-b8a1-408154544ef0: deleting {{(pid=86046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Deleting offline snapshot 8fed8f5e-76a5-4008-9d96-cea427cce350 of volume 3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] snapshot_file for this snap is: volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f35470-ffbb-4a8d-83df-c93375186fbf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:03 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:25:03 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Acquiring lock "cinder-022f40fb-3b6f-4169-b751-752bacb2c270-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "cinder-022f40fb-3b6f-4169-b751-752bacb2c270-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (f545458c-d845-4d7b-bb5b-c289782745a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d4dbfd-c922-4731-a1c7-630bd04b69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d4dbfd-c922-4731-a1c7-630bd04b69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218400820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cc003d-33b1-44b5-982c-f1d680a7f03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:04Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfa74d-0654-4a7f-9a6a-c0df5c06a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfa74d-0654-4a7f-9a6a-c0df5c06a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c738be4-b15d-4057-9cf3-8d294533bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c738be4-b15d-4057-9cf3-8d294533bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4cc003d-33b1-44b5-982c-f1d680a7f03b', 'volume_name': 'volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b4dbd5-5c2b-4d02-9685-5ab96468c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b4dbd5-5c2b-4d02-9685-5ab96468c415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3eec05-c8bb-4297-b230-f7ef1ad1d644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Volume e4cc003d-33b1-44b5-982c-f1d680a7f03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b', 'volume_size': 1} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218400820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cc003d-33b1-44b5-982c-f1d680a7f03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1435c287c5764071a2fc19fdf5a29b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:04Z,use_quota=True,user_id='fa1bebf004d542af8e2915e5160e284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Creating volume e4cc003d-33b1-44b5-982c-f1d680a7f03b {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:03 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Acquiring lock "cinder-quobyte-022f40fb-3b6f-4169-b751-752bacb2c270" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:03 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b 1073741824 Sep 22 18:25:03 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "cinder-quobyte-022f40fb-3b6f-4169-b751-752bacb2c270" acquired by "delete_volume" :: waited 0.051s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b7f95-a9f2-4225-b078-38438acf1ee3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:04 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.544s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb16a9-a71f-4946-a7b0-ae874bb62078]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:04 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 Sep 22 18:25:04 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:25:04 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b 1073741824" returned: 0 in 0.529s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:04 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270" returned: 0 in 0.463s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:04 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b Sep 22 18:25:04 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270 Sep 22 18:25:04 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.636s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:04 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:04 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:25:04 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3eec05-c8bb-4297-b230-f7ef1ad1d644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd513bc5-cae1-4ac2-9920-ca761d0a416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:04 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Volume volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b (e4cc003d-33b1-44b5-982c-f1d680a7f03b): created successfully Sep 22 18:25:04 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd513bc5-cae1-4ac2-9920-ca761d0a416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Flow 'volume_create_manager' (f545458c-d845-4d7b-bb5b-c289782745a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-022f40fb-3b6f-4169-b751-752bacb2c270" returned: 0 in 0.355s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6f5a3ffc-4632-40be-b490-26dfa2e39e9c tempest-AttachVolumeTestJSON-1243952890 None] Created volume successfully. Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "cinder-quobyte-022f40fb-3b6f-4169-b751-752bacb2c270" released by "delete_volume" :: held 0.881s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:04 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Created reservations ['82f77617-f36f-4833-a870-2b5cccec95ee', '59f0d7d2-4588-4025-bdf0-08a89b61fbf6', 'a8d8764a-5f8f-4e12-b724-033182d60a80', 'ae4dc153-f5aa-45ff-970f-987c0afc5c80'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:05 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:05 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:05 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.418s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:05 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350 Sep 22 18:25:05 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:05 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.296s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Deleted volume successfully. Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad28f90e-fd6e-4c83-8c5f-c49266ab9683 tempest-VolumesCloneNegativeTest-1909210911 None] Lock "cinder-022f40fb-3b6f-4169-b751-752bacb2c270-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:05 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd.8fed8f5e-76a5-4008-9d96-cea427cce350" returned: 0 in 0.274s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-8fed8f5e-76a5-4008-9d96-cea427cce350" released by "_delete_snapshot" :: held 2.033s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" released by "delete_snapshot" :: held 2.063s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:05 devstack cinder-volume[86046]: WARNING cinder.quota [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1040785301 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1040785301, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['dbab44f1-f5c3-42ac-9012-577a6aba9c52', '20f71ab3-cce2-46fd-8c3c-c87752776272', 'f66a7116-cd07-4d68-b604-3957094de545', '74c6f39a-0dda-4540-887b-835f0689fa05'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Flow 'volume_create_manager' (2ffbeb69-c480-4462-90d7-459215a6ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c5c527-6ea0-45e6-8716-ae6f4c2b8bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c5c527-6ea0-45e6-8716-ae6f4c2b8bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-909362270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154af06c-9550-4325-b540-99ad09fd5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe4acde2c2e415a9126bd8d3af35eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:06Z,use_quota=True,user_id='74f61c3be14a4037b9f51333ed07f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b98814-5dd9-4d31-ba08-6caf226f0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b98814-5dd9-4d31-ba08-6caf226f0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52396d3a-1245-4c24-8625-36397520f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52396d3a-1245-4c24-8625-36397520f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154af06c-9550-4325-b540-99ad09fd5354', 'volume_name': 'volume-154af06c-9550-4325-b540-99ad09fd5354', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b796195-6c51-43fd-941f-bebba21bc513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b796195-6c51-43fd-941f-bebba21bc513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453c620-5352-46e6-a586-79ae24b048d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Volume 154af06c-9550-4325-b540-99ad09fd5354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154af06c-9550-4325-b540-99ad09fd5354', 'volume_size': 1} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-909362270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154af06c-9550-4325-b540-99ad09fd5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe4acde2c2e415a9126bd8d3af35eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:06Z,use_quota=True,user_id='74f61c3be14a4037b9f51333ed07f795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Creating volume 154af06c-9550-4325-b540-99ad09fd5354 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:05 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:05 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 1073741824 Sep 22 18:25:05 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6f50a6ed-9eab-4187-8fc3-61483befbadf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 2c89299e-0335-44e6-b8a1-408154544ef0: deleted successfully Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:06 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 1073741824" returned: 0 in 0.566s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[267a26b9-95c2-4e63-bfa1-f25519c65820]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:06 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 Sep 22 18:25:06 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:06 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:25:06 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:06 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354" returned: 0 in 0.381s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453c620-5352-46e6-a586-79ae24b048d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154af06c-9550-4325-b540-99ad09fd5354', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38513657-f5db-4ac8-9efa-077aa6bd7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Volume volume-154af06c-9550-4325-b540-99ad09fd5354 (154af06c-9550-4325-b540-99ad09fd5354): created successfully Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38513657-f5db-4ac8-9efa-077aa6bd7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Flow 'volume_create_manager' (2ffbeb69-c480-4462-90d7-459215a6ae04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-457d4123-01f6-4381-b65c-801514e87267 tempest-VolumesMetadataTest-1621900036 None] Created volume successfully. Sep 22 18:25:06 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:06 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd Sep 22 18:25:06 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4a847512-713a-4642-acdc-b3768c18a0c4 req-afaac172-8805-4ac7-b120-5249c9cbbf2d tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4a847512-713a-4642-acdc-b3768c18a0c4 req-afaac172-8805-4ac7-b120-5249c9cbbf2d tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4a847512-713a-4642-acdc-b3768c18a0c4 req-afaac172-8805-4ac7-b120-5249c9cbbf2d tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-4a847512-713a-4642-acdc-b3768c18a0c4 req-afaac172-8805-4ac7-b120-5249c9cbbf2d tempest-AttachVolumeTestJSON-1243952890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce847e74-2748-42d8-9b6f-f3782d848991', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:25:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-4a847512-713a-4642-acdc-b3768c18a0c4 req-afaac172-8805-4ac7-b120-5249c9cbbf2d tempest-AttachVolumeTestJSON-1243952890 None] attachment_update completed successfully. Sep 22 18:25:07 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3847bcf4-5b3a-4b97-88df-76888eeef7bd" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-3847bcf4-5b3a-4b97-88df-76888eeef7bd" released by "delete_volume" :: held 0.937s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['2306ad48-8bc8-4fbc-913c-88f665d786b5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:07 devstack cinder-volume[86046]: WARNING cinder.db.api [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1040785301'] Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['0dd828f7-8d1f-48df-8a46-9ae9770165c7', 'd9f06421-a7e5-4db8-bd3a-1b2e6a809bd9', '56d24954-19b6-4ee1-bb9d-393807a5c8c7', '3f983d49-c03e-404b-b401-134d3322ae3b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:07 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:07 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:07 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.327s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:07 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7c250f8a-8dc0-4964-b117-a6b79a400e6a tempest-GroupSnapshotsTest-1331466253 None] Delete group completed successfully. Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Acquiring lock "cinder-154af06c-9550-4325-b540-99ad09fd5354-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "cinder-154af06c-9550-4325-b540-99ad09fd5354-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Acquiring lock "cinder-quobyte-154af06c-9550-4325-b540-99ad09fd5354" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "cinder-quobyte-154af06c-9550-4325-b540-99ad09fd5354" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8208d-1611-4a36-809e-bd6609ed0ba2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:09 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 Sep 22 18:25:09 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b1c72932-bb69-4ec2-a9c0-e065c14bb1d2 tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-312713084: creating Sep 22 18:25:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b1c72932-bb69-4ec2-a9c0-e065c14bb1d2 tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-312713084: created successfully Sep 22 18:25:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b1c72932-bb69-4ec2-a9c0-e065c14bb1d2 tempest-GroupSnapshotsTest-1331466253 None] Create group completed successfully. Sep 22 18:25:09 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354" returned: 0 in 0.490s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:09 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354 Sep 22 18:25:09 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:09 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-154af06c-9550-4325-b540-99ad09fd5354" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "cinder-quobyte-154af06c-9550-4325-b540-99ad09fd5354" released by "delete_volume" :: held 0.873s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Created reservations ['37190945-7dbc-4b97-b1b4-fd9091c7783e', '51944483-12cd-400d-aa6c-76fbbb6fd3d5', '9111e4d9-f3db-47f7-8dd2-3994886e55b7', '2d83b017-b867-4b02-9592-41fb8ff4851c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:09 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:09 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-25a9e5ec-e720-45be-81e2-c45bd1d19261 req-aa11dd43-d01a-4bfa-89e7-b43608605e9d tempest-AttachVolumeTestJSON-1243952890 None] Terminate volume connection completed successfully. Sep 22 18:25:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-25a9e5ec-e720-45be-81e2-c45bd1d19261 req-aa11dd43-d01a-4bfa-89e7-b43608605e9d tempest-AttachVolumeTestJSON-1243952890 None] Deleting attachment 781dfee5-c086-4ed9-88c1-aa2cce883494. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:25:10 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.368s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:10 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Deleted volume successfully. Sep 22 18:25:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fefa5b0c-45bd-4ee0-b518-c79171a4ee54 tempest-VolumesMetadataTest-1621900036 None] Lock "cinder-154af06c-9550-4325-b540-99ad09fd5354-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (3f1b689e-b210-4f3f-931f-b1ce9365a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5148fd9-53dd-4602-8559-a6c64c3495d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5148fd9-53dd-4602-8559-a6c64c3495d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535500772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72933627-540a-493f-b3b0-64357193eb67,host='devstack@QuobyteHD#QuobyteHD',id=d51c7a82-8263-499d-9801-a1ff296f5457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:11Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f791d56-ba02-42fd-b806-1cc08ba48525),volume_type_id=7f791d56-ba02-42fd-b806-1cc08ba48525)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9eb98-4f0b-4e59-97eb-068766bb5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9eb98-4f0b-4e59-97eb-068766bb5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36613de5-2693-49f8-a392-b05285d53d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36613de5-2693-49f8-a392-b05285d53d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51c7a82-8263-499d-9801-a1ff296f5457', 'volume_name': 'volume-d51c7a82-8263-499d-9801-a1ff296f5457', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a9d63-7c18-4d99-9981-7c6814ea0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a9d63-7c18-4d99-9981-7c6814ea0dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ee805d-f108-456e-aafc-106f6b345496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Volume d51c7a82-8263-499d-9801-a1ff296f5457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51c7a82-8263-499d-9801-a1ff296f5457', 'volume_size': 1} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72933627-540a-493f-b3b0-64357193eb67,created_at=2026-09-22T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535500772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72933627-540a-493f-b3b0-64357193eb67,host='devstack@QuobyteHD#QuobyteHD',id=d51c7a82-8263-499d-9801-a1ff296f5457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:11Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f791d56-ba02-42fd-b806-1cc08ba48525),volume_type_id=7f791d56-ba02-42fd-b806-1cc08ba48525)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Creating volume d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:11 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:11 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 1073741824 Sep 22 18:25:11 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Flow 'volume_create_manager' (88a8b6bf-4f2c-4d9f-a463-ccf370f60b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb13f10-962a-4832-b488-052f24929983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb13f10-962a-4832-b488-052f24929983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-660901533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab9aac6-4654-4dc1-8585-711f927f15f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d01efe0b154d7793b313bd6520f96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:11Z,use_quota=True,user_id='f662c8c45f1147f59ab869feaa7add7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c0874-2e76-41be-8856-5f9a4e962bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27c0874-2e76-41be-8856-5f9a4e962bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f7895a-d10c-4d34-a204-c3f8e532d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:25:11 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 1073741824" returned: 0 in 0.677s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:12 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 Sep 22 18:25:12 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-19a5e0bf-3ca1-4189-860d-bf65916301a7 req-d5ec7edb-8f49-4a8e-a280-f42963952417 tempest-AttachVolumeTestJSON-1243952890 None] Terminate volume connection completed successfully. Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-19a5e0bf-3ca1-4189-860d-bf65916301a7 req-d5ec7edb-8f49-4a8e-a280-f42963952417 tempest-AttachVolumeTestJSON-1243952890 None] Deleting attachment ce847e74-2748-42d8-9b6f-f3782d848991. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f7895a-d10c-4d34-a204-c3f8e532d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ab9aac6-4654-4dc1-8585-711f927f15f7', 'volume_name': 'volume-4ab9aac6-4654-4dc1-8585-711f927f15f7', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a339a8df-b0d4-4f84-b063-0618c19a306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a339a8df-b0d4-4f84-b063-0618c19a306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaf6c95-cda0-475f-8d47-f408780a0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Volume 4ab9aac6-4654-4dc1-8585-711f927f15f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ab9aac6-4654-4dc1-8585-711f927f15f7', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Trying to clone 4ab9aac6-4654-4dc1-8585-711f927f15f7 from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:25:12 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ee805d-f108-456e-aafc-106f6b345496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51c7a82-8263-499d-9801-a1ff296f5457', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fc701-76b6-4bf5-8608-8a6bea266e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Volume volume-d51c7a82-8263-499d-9801-a1ff296f5457 (d51c7a82-8263-499d-9801-a1ff296f5457): created successfully Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fc701-76b6-4bf5-8608-8a6bea266e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (3f1b689e-b210-4f3f-931f-b1ce9365a578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6ca7d488-5e47-45c9-9af5-ae41d5f5ec74 tempest-GroupSnapshotsTest-1331466253 None] Created volume successfully. Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:25:12 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Image download 20.69 MB at 20.69 MB/s Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3ee909-9026-4ade-8f55-23aa302ad26d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:12 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD Sep 22 18:25:12 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:13 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 is fetched for user f662c8c45f1147f59ab869feaa7add7c. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f9d906-08fa-4b1d-a1c8-57a281f3b222]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:13 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD Sep 22 18:25:13 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:13 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-660901533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab9aac6-4654-4dc1-8585-711f927f15f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d01efe0b154d7793b313bd6520f96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:11Z,use_quota=True,user_id='f662c8c45f1147f59ab869feaa7add7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Creating volume 4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:13 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:13 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1073741824 Sep 22 18:25:13 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:14 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1073741824" returned: 0 in 0.793s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:14 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 Sep 22 18:25:14 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (159cf74a-83c4-4fc5-9066-81c053db1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8734b53b-01be-4819-9d85-93c02264a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8734b53b-01be-4819-9d85-93c02264a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506126962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72933627-540a-493f-b3b0-64357193eb67,host='devstack@QuobyteHD#QuobyteHD',id=27e89103-d689-4d95-b3c5-b34e4af32be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:15Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f791d56-ba02-42fd-b806-1cc08ba48525),volume_type_id=7f791d56-ba02-42fd-b806-1cc08ba48525)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4d4a5d-74e3-4e54-ae62-b43dc0f9a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4d4a5d-74e3-4e54-ae62-b43dc0f9a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce734a2-4b33-4fc5-a11f-43f93f3e8e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce734a2-4b33-4fc5-a11f-43f93f3e8e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e89103-d689-4d95-b3c5-b34e4af32be8', 'volume_name': 'volume-27e89103-d689-4d95-b3c5-b34e4af32be8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e63a9c2-76c2-4893-ad9b-d2c97624d2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e63a9c2-76c2-4893-ad9b-d2c97624d2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8693c2-9ac9-4991-b387-a9ea12c8bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:14 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Volume 27e89103-d689-4d95-b3c5-b34e4af32be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e89103-d689-4d95-b3c5-b34e4af32be8', 'volume_size': 1} Sep 22 18:25:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:14 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72933627-540a-493f-b3b0-64357193eb67,created_at=2026-09-22T16:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506126962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72933627-540a-493f-b3b0-64357193eb67,host='devstack@QuobyteHD#QuobyteHD',id=27e89103-d689-4d95-b3c5-b34e4af32be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:15Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f791d56-ba02-42fd-b806-1cc08ba48525),volume_type_id=7f791d56-ba02-42fd-b806-1cc08ba48525)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Creating volume 27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:15 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:15 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 1073741824 Sep 22 18:25:15 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Attempting download of 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 4ab9aac6-4654-4dc1-8585-711f927f15f7. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5299788e-1786-4473-bbc0-73b6b0f944ba]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:15 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85 Sep 22 18:25:15 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:15 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 1073741824" returned: 0 in 0.617s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:15 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 Sep 22 18:25:15 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:15 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85" returned: 0 in 0.695s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:16 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85 Sep 22 18:25:16 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:16 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8" returned: 0 in 0.451s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8693c2-9ac9-4991-b387-a9ea12c8bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e89103-d689-4d95-b3c5-b34e4af32be8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a91b37c-63c0-44c8-ab37-164cc8e2659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Volume volume-27e89103-d689-4d95-b3c5-b34e4af32be8 (27e89103-d689-4d95-b3c5-b34e4af32be8): created successfully Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a91b37c-63c0-44c8-ab37-164cc8e2659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (159cf74a-83c4-4fc5-9066-81c053db1436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5b907dd0-1b6c-4ef0-a80e-c432f4d22c30 tempest-GroupSnapshotsTest-1331466253 None] Created volume successfully. Sep 22 18:25:16 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85" returned: 1 in 0.575s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_wvajbl85' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed80422-4936-44fc-babb-e734fc514e2e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:16 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD Sep 22 18:25:16 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:16 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:25:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:16 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 Sep 22 18:25:16 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fb00f22a-a3f4-44e1-8cbc-5289df6a587f tempest-GroupSnapshotsTest-1331466253 None] Update group completed successfully. Sep 22 18:25:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d5bd27ce-d736-40f5-bbfe-9ce97fc37d8b tempest-GroupSnapshotsTest-1331466253 None] Update group completed successfully. Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-e4cc003d-33b1-44b5-982c-f1d680a7f03b-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-e4cc003d-33b1-44b5-982c-f1d680a7f03b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-quobyte-e4cc003d-33b1-44b5-982c-f1d680a7f03b" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-e4cc003d-33b1-44b5-982c-f1d680a7f03b" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce19a220-0dd8-4f1b-b9d6-87ea3ae203be]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:19 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b Sep 22 18:25:19 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:19 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7" returned: 0 in 2.390s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_eir36yqadevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:25:19 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Converted 112.00 MB image at 46.84 MB/s Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:19 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1G Sep 22 18:25:19 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:19 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:19 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b Sep 22 18:25:19 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:19 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:19 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e4cc003d-33b1-44b5-982c-f1d680a7f03b" returned: 0 in 0.295s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 1G" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Downloaded image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume 4ab9aac6-4654-4dc1-8585-711f927f15f7 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 for user f662c8c45f1147f59ab869feaa7add7c is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Marking volume 4ab9aac6-4654-4dc1-8585-711f927f15f7 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-e4cc003d-33b1-44b5-982c-f1d680a7f03b" released by "delete_volume" :: held 0.804s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Copying metadata from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 to 4ab9aac6-4654-4dc1-8585-711f927f15f7. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Creating volume glance metadata for volume 4ab9aac6-4654-4dc1-8585-711f927f15f7 backed by image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Created reservations ['073fc196-724e-4911-9194-593e6a337489', 'bda1eff5-54a2-43b7-80b5-a2cdfd5de25f', '119fedf3-ed6c-4de1-8174-657718f42f44', '6e0cc7da-e30f-480d-9fff-68955efbf7c7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaf6c95-cda0-475f-8d47-f408780a0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab9aac6-4654-4dc1-8585-711f927f15f7', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72fb973-451d-4f26-9a69-ced862a934de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:19 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Volume volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 (4ab9aac6-4654-4dc1-8585-711f927f15f7): created successfully Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72fb973-451d-4f26-9a69-ced862a934de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Flow 'volume_create_manager' (88a8b6bf-4f2c-4d9f-a463-ccf370f60b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3ed2b52b-f408-4a3f-835e-ee68b65ffa5d tempest-VolumesExtendTest-1161136076 None] Created volume successfully. Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:20 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:20 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-176c688c-f16b-4a15-bf53-701155976759 tempest-GroupSnapshotsTest-1331466253 None] Update group completed successfully. Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-quobyte-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fd13a9-8b2e-4dc9-9367-cd45bedf7798]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:20 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.363s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:20 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 Sep 22 18:25:20 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Deleted volume successfully. Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e72d7fb-7c9e-4b3c-9a19-bf8c2e3e6624 tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-e4cc003d-33b1-44b5-982c-f1d680a7f03b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[982479cc-e9c6-4efd-abdf-dc43af3366e8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:20 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 Sep 22 18:25:20 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:20 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" returned: 0 in 0.505s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:20 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5 Sep 22 18:25:20 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:20 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 2G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 2G" returned: 0 in 0.120s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.585s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:21 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" returned: 0 in 0.278s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5" released by "delete_volume" :: held 0.850s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-71237605-ae09-4c0e-ac73-b4ab03bad619 tempest-VolumesExtendTest-1161136076 None] Extend volume completed successfully. Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Created reservations ['2e1d3567-9285-4b2e-b048-1fa71bdfd829', 'b23c42e7-8034-4719-ac21-a0362b786c57', 'dbb8e587-0e29-4056-ae17-c932eaafc5d7', 'a0d0f8b4-e14e-41b9-b75d-8d19eace89af'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-73d5fb24-a9dc-43d2-9470-6b9214ff42cb tempest-GroupSnapshotsTest-1331466253 None] Update group completed successfully. Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:21 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:21 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:21 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.279s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Deleted volume successfully. Sep 22 18:25:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64491bb8-37ed-447f-b188-d328491c324c tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-1fd54e89-a6bb-47d5-b19e-1ab7e14a2bb5-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-4ab9aac6-4654-4dc1-8585-711f927f15f7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-4ab9aac6-4654-4dc1-8585-711f927f15f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-quobyte-4ab9aac6-4654-4dc1-8585-711f927f15f7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-4ab9aac6-4654-4dc1-8585-711f927f15f7" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad89eb-dbf3-4083-9d0f-737428e87d88]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:22 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 Sep 22 18:25:22 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-7952dc44-c331-4ae1-8a3b-ddc356cd4dce-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-7952dc44-c331-4ae1-8a3b-ddc356cd4dce-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "cinder-quobyte-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49e730-f276-43d4-bffb-a632fc38214d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:22 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7" returned: 0 in 0.494s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:22 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7 Sep 22 18:25:22 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] GroupSnapshot 837e18ed-01c2-4257-a11a-01381094e297: creating. Sep 22 18:25:22 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce Sep 22 18:25:22 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Group snapshot 837e18ed-01c2-4257-a11a-01381094e297: creating. {{(pid=86046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Creating offline snapshot c3bca37b-781e-49e4-bb01-23f350661493 of volume d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c4855-9648-4c2b-a8a6-026d98326163]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:23 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 Sep 22 18:25:23 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:23 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4ab9aac6-4654-4dc1-8585-711f927f15f7" returned: 0 in 0.451s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-4ab9aac6-4654-4dc1-8585-711f927f15f7" released by "delete_volume" :: held 1.010s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:23 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Created reservations ['dcf2ef9e-450a-4d95-8ce4-22ef74f69f0c', '80813a89-dae4-4ade-a004-ab58550df168', '9c744555-c17e-46df-b287-538aac98a3c5', 'c210cdd5-d50b-4033-aede-6f13e6666eb2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:23 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce Sep 22 18:25:23 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:23 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:23 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:23 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457" returned: 0 in 0.483s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:23 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 1G Sep 22 18:25:23 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:23 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-quobyte-7952dc44-c331-4ae1-8a3b-ddc356cd4dce" released by "delete_volume" :: held 0.949s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Created reservations ['f5a031fe-fdce-4337-8183-d1db412453c5', '01e11a42-65ab-4052-baf8-166983b81b05', '88c69799-96aa-4b1d-9082-6afe0ef24318', 'e2990c61-ded8-46df-a88b-96fe348d1b71'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:23 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Deleted volume successfully. Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f5e22011-6ddf-4fed-98ca-90b15adfe217 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-4ab9aac6-4654-4dc1-8585-711f927f15f7-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:23 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:23 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:23 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 1G" returned: 0 in 0.526s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51c7a82-8263-499d-9801-a1ff296f5457 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:24 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51c7a82-8263-499d-9801-a1ff296f5457 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 Sep 22 18:25:24 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:24 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Deleted volume successfully. Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-647507bc-c3a8-400a-953c-64b11416de9d tempest-AttachVolumeTestJSON-1243952890 None] Lock "cinder-7952dc44-c331-4ae1-8a3b-ddc356cd4dce-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:24 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51c7a82-8263-499d-9801-a1ff296f5457 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:24 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:24 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 Sep 22 18:25:24 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:24 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:24 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info Sep 22 18:25:24 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Flow 'volume_create_manager' (9ddd7e75-4c24-46c1-b78c-c652601d3789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a9b284-5441-434d-94c4-a578d4ed204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a9b284-5441-434d-94c4-a578d4ed204f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1179302404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eafea9b-2e65-4c5c-900e-e603c129de10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d01efe0b154d7793b313bd6520f96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:25Z,use_quota=True,user_id='f662c8c45f1147f59ab869feaa7add7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c43a50-5980-4c8c-8577-04eba05e8b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c43a50-5980-4c8c-8577-04eba05e8b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7248514-3bba-4398-beea-1f58dbc78aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:24 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7248514-3bba-4398-beea-1f58dbc78aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eafea9b-2e65-4c5c-900e-e603c129de10', 'volume_name': 'volume-3eafea9b-2e65-4c5c-900e-e603c129de10', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8703a613-aadd-4003-837a-cecd8b515330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8703a613-aadd-4003-837a-cecd8b515330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0345c474-9b83-42bb-ae51-e10a20c73a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Volume 3eafea9b-2e65-4c5c-900e-e603c129de10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eafea9b-2e65-4c5c-900e-e603c129de10', 'volume_size': 1} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info" returned: 0 in 0.391s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:25 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:25 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info Sep 22 18:25:25 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:25 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.info" returned: 0 in 0.335s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Creating offline snapshot c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 of volume 27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85567fe-10f4-4cdb-a049-cbda7e01be4e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:25 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 Sep 22 18:25:25 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:25 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8" returned: 0 in 0.461s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:25 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 1G Sep 22 18:25:25 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:26 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 1G" returned: 0 in 0.522s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e89103-d689-4d95-b3c5-b34e4af32be8 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:26 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e89103-d689-4d95-b3c5-b34e4af32be8 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 Sep 22 18:25:26 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:26 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e89103-d689-4d95-b3c5-b34e4af32be8 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:26 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:26 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 Sep 22 18:25:26 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:27 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" returned: 0 in 0.287s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:27 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info Sep 22 18:25:27 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:27 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info" returned: 0 in 0.274s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:27 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:27 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info Sep 22 18:25:27 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:27 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.info" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.687s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1179302404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eafea9b-2e65-4c5c-900e-e603c129de10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d01efe0b154d7793b313bd6520f96c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:25Z,use_quota=True,user_id='f662c8c45f1147f59ab869feaa7add7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Creating volume 3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:27 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:27 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 1073741824 Sep 22 18:25:27 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f9734a55-69bc-4757-bb8b-f4c8319e192f tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 837e18ed-01c2-4257-a11a-01381094e297: created successfully Sep 22 18:25:28 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 1073741824" returned: 0 in 0.660s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:28 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 837e18ed-01c2-4257-a11a-01381094e297: deleting Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 837e18ed-01c2-4257-a11a-01381094e297: deleting {{(pid=86046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 18:25:28 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:28 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-c3bca37b-781e-49e4-bb01-23f350661493" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-c3bca37b-781e-49e4-bb01-23f350661493" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Deleting offline snapshot c3bca37b-781e-49e4-bb01-23f350661493 of volume d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] snapshot_file for this snap is: volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[999d536a-40fd-4611-b99b-de64b62d22df]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:28 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 Sep 22 18:25:28 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:28 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.581s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0345c474-9b83-42bb-ae51-e10a20c73a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eafea9b-2e65-4c5c-900e-e603c129de10', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a5932-5bf0-458e-99c3-257c0e661208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:29 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Volume volume-3eafea9b-2e65-4c5c-900e-e603c129de10 (3eafea9b-2e65-4c5c-900e-e603c129de10): created successfully Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a5932-5bf0-458e-99c3-257c0e661208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Flow 'volume_create_manager' (9ddd7e75-4c24-46c1-b78c-c652601d3789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a6eb04d4-3f30-4738-b95e-c382a5926a3e tempest-VolumesExtendTest-1161136076 None] Created volume successfully. Sep 22 18:25:29 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493" returned: 0 in 0.512s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d51c7a82-8263-499d-9801-a1ff296f5457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfd530-aa9f-419c-93cb-111d6377b802]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:29 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 Sep 22 18:25:29 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:29 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457" returned: 0 in 0.518s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:29 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 Sep 22 18:25:29 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:30 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493" returned: 0 in 0.539s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:30 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493 Sep 22 18:25:30 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Creating offline snapshot a8308aee-d5aa-4e89-9501-c2daeeb3195c of volume 3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:25:30 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457.c3bca37b-781e-49e4-bb01-23f350661493" returned: 0 in 0.468s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f21755-437a-41a7-856e-9e114229c960]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-c3bca37b-781e-49e4-bb01-23f350661493" released by "_delete_snapshot" :: held 2.265s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" released by "delete_snapshot" :: held 2.311s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Deleting offline snapshot c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 of volume 27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] snapshot_file for this snap is: volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8b1d3-3d06-44f1-b020-95a10ea8709a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:31 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:31 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:31 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 Sep 22 18:25:31 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:31 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.621s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:31 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c 1G Sep 22 18:25:31 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:31 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" returned: 0 in 0.568s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27e89103-d689-4d95-b3c5-b34e4af32be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c91063-1887-4a78-ad30-4c62b0af0aca]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:31 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 Sep 22 18:25:31 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c 1G" returned: 0 in 0.591s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eafea9b-2e65-4c5c-900e-e603c129de10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:32 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eafea9b-2e65-4c5c-900e-e603c129de10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c Sep 22 18:25:32 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8" returned: 0 in 0.569s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:32 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 Sep 22 18:25:32 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eafea9b-2e65-4c5c-900e-e603c129de10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c is being set with open permissions: ugo+rw Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:32 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c Sep 22 18:25:32 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" returned: 0 in 0.382s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:32 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025 Sep 22 18:25:32 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=173,cinder:SELECT=159,cinder:INSERT=48,cinder:DELETE=9 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=146,cinder:DELETE=12,cinder:SELECT=162,cinder:INSERT=46 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:32 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info Sep 22 18:25:32 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:32 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8.c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" returned: 0 in 0.333s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-c4f8b81c-e731-4a7e-a0d0-ab7ce210c025" released by "_delete_snapshot" :: held 2.010s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" released by "delete_snapshot" :: held 2.044s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:33 devstack cinder-volume[86046]: WARNING cinder.quota [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1937217986 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1937217986, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:33 devstack cinder-volume[86046]: WARNING cinder.quota [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1937217986 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1937217986, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:33 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:33 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info is being set with open permissions: ugo+rw Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['0e49564e-c9d0-471f-a50c-cc82e82d3267', '7200aedb-7c1c-4573-9ad4-f757aac448b0', 'a1f3d1df-2492-467f-a09c-d5054dd5382d', '8910379c-fba5-49fa-bb49-60efa7b85fd1'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:33 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info Sep 22 18:25:33 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['bffa6d89-9e1c-4ac2-9669-c78ca81cc458', 'ab8a1505-73b6-44c5-b96e-cf5dbeb91dcb', 'f913069a-049a-4ffd-ad4b-6adcb1dca7ab', '54093667-9d26-4c12-a472-d7694fb50bed'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:33 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.info" returned: 0 in 0.325s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:33 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-50c65a76-7d33-4c6d-85c1-b6f27e78314d tempest-VolumesExtendTest-1161136076 None] Create snapshot completed successfully Sep 22 18:25:33 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a7c70153-b074-4149-97fc-fc5334e4d52f tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 837e18ed-01c2-4257-a11a-01381094e297: deleted successfully Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b2d01-3942-4f7e-8e33-0f327de1c1a6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:34 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:34 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:34 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.508s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c 2G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c 2G" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.798s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cc728462-cc37-4b59-95fe-0c24f9404018 tempest-VolumesExtendTest-1161136076 None] Extend volume completed successfully. Sep 22 18:25:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49eb789-d68d-42ec-8b7e-f0adf861c753]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:35 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 Sep 22 18:25:35 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-a8308aee-d5aa-4e89-9501-c2daeeb3195c-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-a8308aee-d5aa-4e89-9501-c2daeeb3195c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-quobyte-a8308aee-d5aa-4e89-9501-c2daeeb3195c" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-a8308aee-d5aa-4e89-9501-c2daeeb3195c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Deleting offline snapshot a8308aee-d5aa-4e89-9501-c2daeeb3195c of volume 3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] snapshot_file for this snap is: volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92924a99-b6d6-4a2a-9d5a-eb879ba4fd90]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:35 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8" returned: 0 in 0.547s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:35 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8 Sep 22 18:25:35 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:35 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c Sep 22 18:25:35 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:35 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-27e89103-d689-4d95-b3c5-b34e4af32be8" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-27e89103-d689-4d95-b3c5-b34e4af32be8" released by "delete_volume" :: held 0.914s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:36 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c" returned: 0 in 0.521s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eafea9b-2e65-4c5c-900e-e603c129de10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9f2786-2251-4526-984d-69cb015accf6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6813a99-ad16-4778-acad-bd54b96d0203]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:36 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:36 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:36 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 Sep 22 18:25:36 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:36 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.497s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:36 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457" returned: 0 in 0.535s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:36 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c Sep 22 18:25:36 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:36 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457 Sep 22 18:25:36 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:36 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d51c7a82-8263-499d-9801-a1ff296f5457" returned: 0 in 0.318s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-d51c7a82-8263-499d-9801-a1ff296f5457" released by "delete_volume" :: held 0.989s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:37 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['68b16a22-ac27-4c87-b9d4-196cfc423359'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c" returned: 0 in 0.488s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:37 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c Sep 22 18:25:37 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:37 devstack cinder-volume[86046]: WARNING cinder.quota [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1937217986 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1937217986, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['315b13b1-f4b0-42d4-9cf8-7b1ca826cd79', '5112fc01-3f01-4d55-9def-cb0e1b967af1', '94484486-b58e-477b-af79-3b082e6f9b7e', '03542953-1e29-432d-8e95-fb1a826b2a1d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['1876ee84-1ad2-415d-81bd-b44ca1f55d2c', 'cfb81a3b-fff0-4621-b972-3a651ec5cd37', '2fd4a128-ef30-4430-a11b-f8fdbf3c219d', 'bd32bc13-19cf-4108-b579-53b87e580af6'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:37 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10.a8308aee-d5aa-4e89-9501-c2daeeb3195c" returned: 0 in 0.377s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:37 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:37 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-a8308aee-d5aa-4e89-9501-c2daeeb3195c" released by "_delete_snapshot" :: held 2.066s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" released by "delete_snapshot" :: held 2.120s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Created reservations ['47a02ea4-e8fd-4597-830e-88d22e6ee9c5', 'cc5527d5-8d15-4d26-9827-ebdb7e1e5a26', '87c6a3b8-41ac-4ada-86f8-e69876dafabc', '3172c77b-cb7f-4279-9d13-9ad38e6fa196'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Delete snapshot completed successfully. Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-df3f039f-4bd1-4b4d-9d7d-d879aa67855c tempest-VolumesExtendTest-1161136076 None] Lock "cinder-a8308aee-d5aa-4e89-9501-c2daeeb3195c-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:37 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.509s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:37 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-74ca48c9-33bb-44f5-8d3d-ef22af64e470 tempest-GroupSnapshotsTest-1331466253 None] Delete group completed successfully. Sep 22 18:25:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-393da65b-1147-4278-92d1-e6b44817b3ae tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-1449254598: creating Sep 22 18:25:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-393da65b-1147-4278-92d1-e6b44817b3ae tempest-GroupSnapshotsTest-1331466253 None] Group tempest-GroupSnapshotsTest-Group-1449254598: created successfully Sep 22 18:25:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-393da65b-1147-4278-92d1-e6b44817b3ae tempest-GroupSnapshotsTest-1331466253 None] Create group completed successfully. Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Flow 'volume_create_manager' (bcae0527-2216-4cab-a7bc-8b62f1a461cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867d5c4-6a77-4345-aa91-19af07a2522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867d5c4-6a77-4345-aa91-19af07a2522a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-300922560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad48b0-343a-46a0-bde9-1e05f635c5fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f55a673e134e1d84dda3983eb92bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:39Z,use_quota=True,user_id='d137471994b84671a45a61676832a762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47a96c-3bf6-4462-ade2-93f7e4e8a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47a96c-3bf6-4462-ade2-93f7e4e8a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0d6402-baaa-4547-8cc6-45bd9e00cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0d6402-baaa-4547-8cc6-45bd9e00cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ad48b0-343a-46a0-bde9-1e05f635c5fa', 'volume_name': 'volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48d01fd-0c88-4cff-b36c-6700e8a1e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48d01fd-0c88-4cff-b36c-6700e8a1e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5060c7c2-ea10-4f1c-a6f7-4d20be43334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:38 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Volume 29ad48b0-343a-46a0-bde9-1e05f635c5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa', 'volume_size': 1} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-300922560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad48b0-343a-46a0-bde9-1e05f635c5fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f8f55a673e134e1d84dda3983eb92bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:39Z,use_quota=True,user_id='d137471994b84671a45a61676832a762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Creating volume 29ad48b0-343a-46a0-bde9-1e05f635c5fa {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:38 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-3eafea9b-2e65-4c5c-900e-e603c129de10-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:38 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa 1073741824 Sep 22 18:25:38 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-3eafea9b-2e65-4c5c-900e-e603c129de10-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b25d567-9bff-4dc9-a5b1-2a5a9c7daf61]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:39 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:39 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:39 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa 1073741824" returned: 0 in 0.659s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:39 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.499s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:39 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10 Sep 22 18:25:39 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:39 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa Sep 22 18:25:39 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:39 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa" returned: 0 in 0.382s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5060c7c2-ea10-4f1c-a6f7-4d20be43334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:39 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155ad370-c663-4185-9042-3e36f4ebac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3eafea9b-2e65-4c5c-900e-e603c129de10" returned: 0 in 0.478s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:39 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Volume volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa (29ad48b0-343a-46a0-bde9-1e05f635c5fa): created successfully Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155ad370-c663-4185-9042-3e36f4ebac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Flow 'volume_create_manager' (bcae0527-2216-4cab-a7bc-8b62f1a461cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-quobyte-3eafea9b-2e65-4c5c-900e-e603c129de10" released by "delete_volume" :: held 1.079s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-66de6af4-1e26-4a97-89b2-eb0dbf48467d req-e70b3ee7-0629-4bd0-9cf6-77e84165af1e tempest-VolumesGetTestJSON-1113586333 None] Created volume successfully. Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Created reservations ['17e09c18-1dff-4c54-bed6-cf344b8d6cca', 'a4e83ba6-fc4d-4d5e-9709-9e9843b4c1b9', '98824b2f-20cf-4fac-b974-f0dcde8af083', '3ddeeb04-c951-4bc7-ac9e-37e3b7fd615d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:40 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:40 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (85dead3b-b06d-4339-bd16-49adcddbd7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12bc3ed-6af7-4712-b000-d86fc4defae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12bc3ed-6af7-4712-b000-d86fc4defae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519727471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe89868b-c61b-4a26-98a4-553ab38fe048,host='devstack@QuobyteHD#QuobyteHD',id=7ad42ba4-5d5f-4662-adc6-cedf7b84d42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:40Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eb8bc27-1dda-44cb-be62-d7f96fb970d5),volume_type_id=8eb8bc27-1dda-44cb-be62-d7f96fb970d5)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56247f13-0e04-4fc5-a9d3-f5a4e974a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56247f13-0e04-4fc5-a9d3-f5a4e974a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e76933-466a-4dfc-8fde-1a441169b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e76933-466a-4dfc-8fde-1a441169b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad42ba4-5d5f-4662-adc6-cedf7b84d42b', 'volume_name': 'volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ca49e8-f7b3-4791-8db8-4fefeec95c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ca49e8-f7b3-4791-8db8-4fefeec95c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247cd781-c3ac-4ad8-8c92-bc44d5f14f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:40 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Volume 7ad42ba4-5d5f-4662-adc6-cedf7b84d42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b', 'volume_size': 1} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe89868b-c61b-4a26-98a4-553ab38fe048,created_at=2026-09-22T16:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519727471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe89868b-c61b-4a26-98a4-553ab38fe048,host='devstack@QuobyteHD#QuobyteHD',id=7ad42ba4-5d5f-4662-adc6-cedf7b84d42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d434a019527148a8a4b6309eeb6d44cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:40Z,use_quota=True,user_id='473399ea9ab74504bf052bbde6d5fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eb8bc27-1dda-44cb-be62-d7f96fb970d5),volume_type_id=8eb8bc27-1dda-44cb-be62-d7f96fb970d5)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Creating volume 7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:40 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:40 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b 1073741824 Sep 22 18:25:40 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:40 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.379s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Deleted volume successfully. Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-13f000c5-9486-48c5-ada6-0ca5eb28e449 tempest-VolumesExtendTest-1161136076 None] Lock "cinder-3eafea9b-2e65-4c5c-900e-e603c129de10-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:40 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b 1073741824" returned: 0 in 0.571s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:41 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b Sep 22 18:25:41 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Acquiring lock "cinder-29ad48b0-343a-46a0-bde9-1e05f635c5fa-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "cinder-29ad48b0-343a-46a0-bde9-1e05f635c5fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Acquiring lock "cinder-quobyte-29ad48b0-343a-46a0-bde9-1e05f635c5fa" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "cinder-quobyte-29ad48b0-343a-46a0-bde9-1e05f635c5fa" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[700ddda0-0155-434c-a96b-264660a2f6bf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:41 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa Sep 22 18:25:41 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:41 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" returned: 0 in 0.517s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247cd781-c3ac-4ad8-8c92-bc44d5f14f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2206f38b-dbd2-4a55-9457-6c4ffe4170b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:41 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Volume volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b (7ad42ba4-5d5f-4662-adc6-cedf7b84d42b): created successfully Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2206f38b-dbd2-4a55-9457-6c4ffe4170b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Flow 'volume_create_manager' (85dead3b-b06d-4339-bd16-49adcddbd7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6e602590-1864-4d73-bc08-353507ef4ec9 tempest-GroupSnapshotsTest-1331466253 None] Created volume successfully. Sep 22 18:25:41 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa" returned: 0 in 0.502s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:41 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa Sep 22 18:25:41 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:42 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-29ad48b0-343a-46a0-bde9-1e05f635c5fa" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "cinder-quobyte-29ad48b0-343a-46a0-bde9-1e05f635c5fa" released by "delete_volume" :: held 0.844s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.quota [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Created reservations ['3583e511-51f5-4a1f-b4f9-c4dfd3e57e92', 'ae9e4307-c523-4dcc-9503-bd24ff943bd5', '2ffd1daa-a88d-49c3-9f99-71dcab9fac26', '1ba61068-6bd2-46d3-aaa4-b9a0ca6d5f2c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:42 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:42 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:42 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.540s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.manager [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Deleted volume successfully. Sep 22 18:25:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-70ee283b-bc6d-432b-aca4-49e9a43df5fb req-3eafb344-be62-47a0-b3e0-8c57b7afe131 tempest-VolumesGetTestJSON-1113586333 None] Lock "cinder-29ad48b0-343a-46a0-bde9-1e05f635c5fa-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] GroupSnapshot 51566470-8137-4e7b-8229-cce85f008ab1: creating. Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Group snapshot 51566470-8137-4e7b-8229-cce85f008ab1: creating. {{(pid=86046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Creating offline snapshot 529ba807-ac99-4e71-b8a4-ec5c4f8b1509 of volume 7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[072081a5-0ade-408c-92ae-822ff38fbb6f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:43 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b Sep 22 18:25:43 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:43 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" returned: 0 in 0.474s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:43 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 1G Sep 22 18:25:43 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:44 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 1G" returned: 0 in 0.570s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:44 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 Sep 22 18:25:44 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:44 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509" returned: 0 in 0.450s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:44 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:44 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 Sep 22 18:25:44 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:45 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:45 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info Sep 22 18:25:45 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:45 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info" returned: 0 in 0.373s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:45 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:45 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info Sep 22 18:25:45 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:45 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.info" returned: 0 in 0.318s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b2ca728b-1355-4fd9-85d1-1b30d766ff30 tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 51566470-8137-4e7b-8229-cce85f008ab1: created successfully Sep 22 18:25:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 51566470-8137-4e7b-8229-cce85f008ab1: deleting Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 51566470-8137-4e7b-8229-cce85f008ab1: deleting {{(pid=86046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-529ba807-ac99-4e71-b8a4-ec5c4f8b1509" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-529ba807-ac99-4e71-b8a4-ec5c4f8b1509" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Deleting offline snapshot 529ba807-ac99-4e71-b8a4-ec5c4f8b1509 of volume 7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] snapshot_file for this snap is: volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7c4d0-4240-4e76-9c24-bb81d45e8323]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:47 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 Sep 22 18:25:47 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:47 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509" returned: 0 in 0.590s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (b35c4196-205c-42a6-9022-beac471c0d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ac7b4-88e7-402e-8365-8279520bb197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820d3dd-efc6-445b-b01f-09c81f2acd67]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ac7b4-88e7-402e-8365-8279520bb197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855489356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e45750-0208-40c3-bed5-5fd5d9bd9c79,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:47Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b09446-0652-49d3-9069-5e26b0bb613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b09446-0652-49d3-9069-5e26b0bb613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a59a60-8f7a-494f-abb1-64de9e99aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a59a60-8f7a-494f-abb1-64de9e99aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e45750-0208-40c3-bed5-5fd5d9bd9c79', 'volume_name': 'volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54723a45-0a61-42a2-9a18-196bf15f2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54723a45-0a61-42a2-9a18-196bf15f2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2501b8-fd84-4552-9793-4fa15b549c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Volume e9e45750-0208-40c3-bed5-5fd5d9bd9c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79', 'volume_size': 1} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855489356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e45750-0208-40c3-bed5-5fd5d9bd9c79,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:47Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Creating volume e9e45750-0208-40c3-bed5-5fd5d9bd9c79 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:47 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:47 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b Sep 22 18:25:47 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:47 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 1073741824 Sep 22 18:25:47 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (2701014f-cccb-4ac7-977a-e22be0851cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fcfd4a-b8b2-4b54-af1b-06392ad1a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fcfd4a-b8b2-4b54-af1b-06392ad1a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1163523961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff445e7b-f476-44d8-b2c1-9615c38c0a62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:48Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d093f-9bdd-4ac5-b8bc-8f652cc5ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d093f-9bdd-4ac5-b8bc-8f652cc5ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2268bbb-c838-4175-b71e-ab5a77f0edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2268bbb-c838-4175-b71e-ab5a77f0edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff445e7b-f476-44d8-b2c1-9615c38c0a62', 'volume_name': 'volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c721301e-e5d4-4c8a-9de2-f7053a6d120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c721301e-e5d4-4c8a-9de2-f7053a6d120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2ac3a1-7591-4745-abfd-30b7cbf24162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Volume ff445e7b-f476-44d8-b2c1-9615c38c0a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62', 'volume_size': 1} Sep 22 18:25:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:48 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:48 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 Sep 22 18:25:48 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:48 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 1073741824" returned: 0 in 0.576s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:48 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 Sep 22 18:25:48 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:48 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509" returned: 0 in 0.432s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:48 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509 Sep 22 18:25:48 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:48 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:48 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:48 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" returned: 0 in 0.314s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1163523961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff445e7b-f476-44d8-b2c1-9615c38c0a62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:48Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Creating volume ff445e7b-f476-44d8-b2c1-9615c38c0a62 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:48 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2501b8-fd84-4552-9793-4fa15b549c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a29cc-37be-443c-a9c1-960a47a2a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:48 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 1073741824 Sep 22 18:25:48 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Volume volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 (e9e45750-0208-40c3-bed5-5fd5d9bd9c79): created successfully Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a29cc-37be-443c-a9c1-960a47a2a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (b35c4196-205c-42a6-9022-beac471c0d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bfbb0257-050f-4814-a589-56a65ad65956 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:25:48 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b.529ba807-ac99-4e71-b8a4-ec5c4f8b1509" returned: 0 in 0.423s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-529ba807-ac99-4e71-b8a4-ec5c4f8b1509" released by "_delete_snapshot" :: held 2.098s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" released by "delete_snapshot" :: held 2.138s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:25:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:25:49 devstack cinder-volume[86046]: WARNING cinder.quota [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-303248570 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-303248570, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:49 devstack cinder-volume[86046]: WARNING cinder.quota [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-303248570 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-303248570, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['2ded50ae-90e7-416a-85af-54d7c300f15c', 'ea4b5ffd-6430-465e-b971-c3f09fa7a022', '1fd37a07-759d-48a1-90b8-12bcf7c3854f', '5d2277a4-aa2e-4cdb-b85c-69ec58651a34'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ea90fb4e-76b3-4105-a3d9-a7e2ca4999bf tempest-GroupSnapshotsTest-1331466253 None] group_snapshot 51566470-8137-4e7b-8229-cce85f008ab1: deleted successfully Sep 22 18:25:49 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 1073741824" returned: 0 in 0.620s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:49 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 Sep 22 18:25:49 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:49 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62" returned: 0 in 0.410s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2ac3a1-7591-4745-abfd-30b7cbf24162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3aa416-df36-414e-b1f2-07e858678eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Volume volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 (ff445e7b-f476-44d8-b2c1-9615c38c0a62): created successfully Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3aa416-df36-414e-b1f2-07e858678eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (2701014f-cccb-4ac7-977a-e22be0851cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ff463b6d-0b03-49a5-be05-b54da385beb7 tempest-VolumesTestJSON-1114536527 None] Created volume successfully. Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" acquired by "delete_volume" :: waited 0.037s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2f35a-16cc-4531-94b5-90800d5d92a0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:50 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b Sep 22 18:25:50 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:50 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" returned: 0 in 0.526s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:50 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b Sep 22 18:25:50 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:51 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" returned: 0 in 0.333s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Lock "cinder-quobyte-7ad42ba4-5d5f-4662-adc6-cedf7b84d42b" released by "delete_volume" :: held 1.008s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['ebe1f86f-2d0d-4f88-8a92-09a9a6fdf2fc'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (b747f3b3-e57f-4764-9d0b-955173a99440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe5becb-cb31-4e1d-886d-d9794fce745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe5becb-cb31-4e1d-886d-d9794fce745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-624983784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e040612-2747-4587-bc8a-01b593b66725,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:51Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf0ffb6-8cbc-42e4-9290-84fdc6cd6010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf0ffb6-8cbc-42e4-9290-84fdc6cd6010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6bcb87-735a-4dad-bf73-620e4e02e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6bcb87-735a-4dad-bf73-620e4e02e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e040612-2747-4587-bc8a-01b593b66725', 'volume_name': 'volume-9e040612-2747-4587-bc8a-01b593b66725', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86b8358-3aae-4044-8be2-0e75b6ef91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86b8358-3aae-4044-8be2-0e75b6ef91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210a7620-b5a1-41d7-8a42-d6eb7edf650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Volume 9e040612-2747-4587-bc8a-01b593b66725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e040612-2747-4587-bc8a-01b593b66725', 'volume_size': 1} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-624983784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e040612-2747-4587-bc8a-01b593b66725,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:51Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Creating volume 9e040612-2747-4587-bc8a-01b593b66725 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:51 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:51 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 1073741824 Sep 22 18:25:51 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (e84b6bca-b7fb-41ca-a851-d70e9466ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471e2c2b-bfea-447d-b1c2-28845a931d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: WARNING cinder.quota [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-303248570 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-303248570, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471e2c2b-bfea-447d-b1c2-28845a931d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340964459',display_name='tempest-VolumesGetTest-Volume-934871888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44896c12-bec1-4e1c-b829-390401af3ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:51Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76291e45-a261-4d37-97ca-cc940362ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76291e45-a261-4d37-97ca-cc940362ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e12a3-29c6-4d83-92a3-b6af8d435590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e12a3-29c6-4d83-92a3-b6af8d435590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44896c12-bec1-4e1c-b829-390401af3ca1', 'volume_name': 'volume-44896c12-bec1-4e1c-b829-390401af3ca1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0056b8bb-bba7-40c5-ba59-ffef68aa6ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0056b8bb-bba7-40c5-ba59-ffef68aa6ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca6ae1d-e052-4b29-87ca-b1ffe3b64a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Volume 44896c12-bec1-4e1c-b829-390401af3ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44896c12-bec1-4e1c-b829-390401af3ca1', 'volume_size': 1} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Created reservations ['721cf268-c141-421d-b28e-2adc8a60cea8', '7a40991c-b0e5-4315-be8a-492f746e26c3', 'db2d19f2-e379-48a2-b5d0-f54f3b59937d', '9ac34c5b-9ec9-4d57-a0d8-db78f60d0ad3'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:51 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:51 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:52 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-687eaeb3-48f9-4bec-93e4-888093fd00ae tempest-GroupSnapshotsTest-1331466253 None] Delete group completed successfully. Sep 22 18:25:52 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 1073741824" returned: 0 in 0.677s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:52 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 Sep 22 18:25:52 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:52 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340964459',display_name='tempest-VolumesGetTest-Volume-934871888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44896c12-bec1-4e1c-b829-390401af3ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:51Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Creating volume 44896c12-bec1-4e1c-b829-390401af3ca1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:52 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:52 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 1073741824 Sep 22 18:25:52 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210a7620-b5a1-41d7-8a42-d6eb7edf650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e040612-2747-4587-bc8a-01b593b66725', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae0511-63d8-4e03-a9a8-04a8b56aa3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:52 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Volume volume-9e040612-2747-4587-bc8a-01b593b66725 (9e040612-2747-4587-bc8a-01b593b66725): created successfully Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bae0511-63d8-4e03-a9a8-04a8b56aa3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (b747f3b3-e57f-4764-9d0b-955173a99440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ae3a081a-bb5e-4612-b5c1-d2ac49236137 tempest-VolumesTestJSON-1114536527 None] Created volume successfully. Sep 22 18:25:53 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 1073741824" returned: 0 in 0.976s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:53 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 Sep 22 18:25:53 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:54 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1" returned: 0 in 0.629s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca6ae1d-e052-4b29-87ca-b1ffe3b64a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44896c12-bec1-4e1c-b829-390401af3ca1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e40e4ee-f9e8-4eaa-95ad-00065725c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Volume volume-44896c12-bec1-4e1c-b829-390401af3ca1 (44896c12-bec1-4e1c-b829-390401af3ca1): created successfully Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e40e4ee-f9e8-4eaa-95ad-00065725c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (e84b6bca-b7fb-41ca-a851-d70e9466ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-de0a4669-6852-4360-83d7-07b1ed304de3 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (0a2e20e8-f5d4-4cab-9ad4-4626eb54e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453a7bf4-4546-4f6a-92a5-f7764de77d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453a7bf4-4546-4f6a-92a5-f7764de77d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-734514275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:55Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13850a10-ffb3-416e-9d2b-2d9e4db4d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13850a10-ffb3-416e-9d2b-2d9e4db4d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1eb3e-5c6c-4e75-8c89-3e7cfd23702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1eb3e-5c6c-4e75-8c89-3e7cfd23702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c', 'volume_name': 'volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba02911-47c0-464d-82cb-17014f761028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba02911-47c0-464d-82cb-17014f761028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fa76c4-81d0-4301-b7ff-a4ea0ba2189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Volume d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c', 'volume_size': 1} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-734514275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc399b9017cc4c6f995c32ac227b0bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:25:55Z,use_quota=True,user_id='2a8d9d6a81f7401394bdeb1fb616c199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Creating volume d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:25:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-44896c12-bec1-4e1c-b829-390401af3ca1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:54 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c 1073741824 Sep 22 18:25:54 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "cinder-44896c12-bec1-4e1c-b829-390401af3ca1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-44896c12-bec1-4e1c-b829-390401af3ca1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-44896c12-bec1-4e1c-b829-390401af3ca1" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed457bb0-1a08-47eb-96c4-523007aedff1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:55 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 Sep 22 18:25:55 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:55 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c 1073741824" returned: 0 in 0.787s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:55 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c Sep 22 18:25:55 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:55 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1" returned: 0 in 0.650s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:55 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1 Sep 22 18:25:55 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:56 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" returned: 0 in 0.427s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fa76c4-81d0-4301-b7ff-a4ea0ba2189a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7679e3d1-41bb-4621-aee1-37dffe7d08ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:25:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Volume volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c (d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c): created successfully Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7679e3d1-41bb-4621-aee1-37dffe7d08ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Flow 'volume_create_manager' (0a2e20e8-f5d4-4cab-9ad4-4626eb54e424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:25:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1a005be6-fba6-46b9-8bde-6bd1cbafd8c4 tempest-VolumesTestJSON-1114536527 None] Created volume successfully. Sep 22 18:25:56 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-44896c12-bec1-4e1c-b829-390401af3ca1" returned: 0 in 0.462s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-44896c12-bec1-4e1c-b829-390401af3ca1" released by "delete_volume" :: held 1.247s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Created reservations ['e1c26fbd-98c2-4444-95f2-6aad01c96835', 'c1d1b82f-8e8c-471b-8240-217533fbb18b', '5eec6fda-b2c6-48f6-be0a-6b40c67249f8', 'b39b591a-4164-4f40-a3b5-a63529f07a51'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:56 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:56 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:56 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:25:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:25:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-875f5e22-4555-4bbc-95ee-74336dce32ff tempest-VolumesGetTest-1526341479 None] Lock "cinder-44896c12-bec1-4e1c-b829-390401af3ca1-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-e9e45750-0208-40c3-bed5-5fd5d9bd9c79-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "cinder-e9e45750-0208-40c3-bed5-5fd5d9bd9c79-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" acquired by "delete_volume" :: waited 0.055s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e9b27-5d84-4820-9781-641a217173ed]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:58 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 Sep 22 18:25:58 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:58 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" returned: 0 in 0.635s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:58 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79 Sep 22 18:25:58 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-quobyte-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177b2ce-e3ff-4f45-83d2-36d4989cef1b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:25:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:58 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c Sep 22 18:25:58 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:59 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" returned: 0 in 0.613s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-e9e45750-0208-40c3-bed5-5fd5d9bd9c79" released by "delete_volume" :: held 1.341s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Created reservations ['e1bb7ad1-ede7-456e-9963-b89bd4dad683', '0b74b208-5c6e-4282-a7c1-ce426acefa0b', '60f256f6-c170-4055-91e1-158341756037', 'cd2772d8-0aa9-4f1a-8cb5-3c6b8179a662'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:59 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" returned: 0 in 0.631s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:59 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c Sep 22 18:25:59 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:25:59 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:25:59 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:25:59 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" returned: 0 in 0.366s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c" released by "delete_volume" :: held 1.104s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:25:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Created reservations ['ebb2f658-37bb-488a-af00-fe77de7cff48', '3e6d6ef5-13cf-401d-a007-7cdfa6e697ae', 'ca2dc563-cb7d-4160-966e-c8276bc40888', '4b79b07f-5610-43ca-aea5-64539f993415'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:25:59 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.602s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbc73f57-c817-4aeb-8045-a3a4c409f8ab tempest-VolumesGetTest-1526341479 None] Lock "cinder-e9e45750-0208-40c3-bed5-5fd5d9bd9c79-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:00 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:00 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:00 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.651s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Deleted volume successfully. Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45e87a7c-31db-4036-81d6-dbb937ba40e9 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-d1d4c5d5-a9a2-4f7d-9ae3-5468ccb2b13c-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (aea7f308-51c9-4583-a5a7-6f1a507dc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f86fa1b-1014-4761-904f-a1f049cdfdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-9e040612-2747-4587-bc8a-01b593b66725-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f86fa1b-1014-4761-904f-a1f049cdfdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1958747915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c979e5-f69d-41f9-bc8f-4579d0fde1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:01Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f863f2-95c2-44e8-94a5-8002c914da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f863f2-95c2-44e8-94a5-8002c914da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6d42c8-929a-4a9a-9f65-23eab3bf2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6d42c8-929a-4a9a-9f65-23eab3bf2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'volume_name': 'volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70b7b1a-1fc0-4f28-bc08-748e7de5ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70b7b1a-1fc0-4f28-bc08-748e7de5ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca5353f-588e-4b0e-ba6d-30d46a9e77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Volume 87c979e5-f69d-41f9-bc8f-4579d0fde1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'volume_size': 1} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1958747915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c979e5-f69d-41f9-bc8f-4579d0fde1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:01Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Creating volume 87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:01 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-9e040612-2747-4587-bc8a-01b593b66725-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:01 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf 1073741824 Sep 22 18:26:01 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-quobyte-9e040612-2747-4587-bc8a-01b593b66725" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-9e040612-2747-4587-bc8a-01b593b66725" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb65b8-cc4c-4b03-b917-c81e812785e3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:01 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 Sep 22 18:26:01 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:01 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf 1073741824" returned: 0 in 0.546s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:01 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725" returned: 0 in 0.509s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:01 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:01 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:01 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725 Sep 22 18:26:01 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:02 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.390s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca5353f-588e-4b0e-ba6d-30d46a9e77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5a1a98-1669-450a-9366-12a5798246c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:02 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Volume volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf (87c979e5-f69d-41f9-bc8f-4579d0fde1cf): created successfully Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5a1a98-1669-450a-9366-12a5798246c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (aea7f308-51c9-4583-a5a7-6f1a507dc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e040612-2747-4587-bc8a-01b593b66725" returned: 0 in 0.430s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e1640bdc-6b63-4630-ab4f-78e1236d2c36 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-9e040612-2747-4587-bc8a-01b593b66725" released by "delete_volume" :: held 1.006s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Created reservations ['1490b376-9c48-4076-9ae7-bd5487c34710', 'c4dbac99-bb78-441f-8144-ee7e62a79add', '8840423f-7e26-4149-9025-e55ad6250817', '7c159c94-cf05-4c21-9a9a-8be8b362e250'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:02 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:02 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:02 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Deleted volume successfully. Sep 22 18:26:02 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f1ce3bde-0daa-4bc9-837c-2c96fea533e6 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-9e040612-2747-4587-bc8a-01b593b66725-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a55fc0db-c66d-4fb5-9b38-192eef4471f0 tempest-GroupSnapshotsV319Test-29709201 None] Group tempest-GroupSnapshotsV319Test-Group-1250871256: creating Sep 22 18:26:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a55fc0db-c66d-4fb5-9b38-192eef4471f0 tempest-GroupSnapshotsV319Test-29709201 None] Group tempest-GroupSnapshotsV319Test-Group-1250871256: created successfully Sep 22 18:26:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a55fc0db-c66d-4fb5-9b38-192eef4471f0 tempest-GroupSnapshotsV319Test-29709201 None] Create group completed successfully. Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-ff445e7b-f476-44d8-b2c1-9615c38c0a62-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-ff445e7b-f476-44d8-b2c1-9615c38c0a62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "cinder-quobyte-ff445e7b-f476-44d8-b2c1-9615c38c0a62" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-ff445e7b-f476-44d8-b2c1-9615c38c0a62" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefba814-190c-451f-bbcb-2bd9fc602941]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:03 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 Sep 22 18:26:03 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (951000fe-4607-44ee-abf7-996690f1f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba77709-8b17-4d1c-8e83-516625b36361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba77709-8b17-4d1c-8e83-516625b36361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-606913908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40731b76-086d-474e-9d25-37288a95221a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=87c979e5-f69d-41f9-bc8f-4579d0fde1cf,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:04Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be5f81d-ed3e-44cd-9dc9-b3267a0d3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be5f81d-ed3e-44cd-9dc9-b3267a0d3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab9669-53c2-4def-a929-99c712c111a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab9669-53c2-4def-a929-99c712c111a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40731b76-086d-474e-9d25-37288a95221a', 'volume_name': 'volume-40731b76-086d-474e-9d25-37288a95221a', 'volume_size': 1, 'source_volid': '87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'source_volstatus': 'available'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14da1a56-bcc3-462a-b262-81ceb34da23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14da1a56-bcc3-462a-b262-81ceb34da23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f21e346-0c0c-4257-91d2-dd2e004eb8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Volume 40731b76-086d-474e-9d25-37288a95221a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40731b76-086d-474e-9d25-37288a95221a', 'volume_size': 1, 'source_volid': '87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'source_volstatus': 'available'} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:03 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Cloning volume 87c979e5-f69d-41f9-bc8f-4579d0fde1cf to volume 40731b76-086d-474e-9d25-37288a95221a Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Creating offline snapshot 4cc0a462-f2de-4406-9e2c-a410adde962a of volume 87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6fb6e1-712f-4d37-84e0-db39e182a5fc]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:03 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62" returned: 0 in 0.451s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:03 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62 Sep 22 18:26:03 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:03 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:03 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:04 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff445e7b-f476-44d8-b2c1-9615c38c0a62" returned: 0 in 0.281s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-quobyte-ff445e7b-f476-44d8-b2c1-9615c38c0a62" released by "delete_volume" :: held 0.810s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:04 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.427s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Created reservations ['8c305670-a402-4344-b8da-0e8c09c57a12', '46deafc5-2fa2-4164-86c0-d955609364a6', '7567a211-9d50-481d-bf12-332f78530d73', 'b512f7d3-b01d-4e06-b295-231f33443e7d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:04 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a 1G Sep 22 18:26:04 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:04 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:04 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:04 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.527s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:04 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Deleted volume successfully. Sep 22 18:26:05 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a 1G" returned: 0 in 0.763s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6ab960a1-af10-4455-8fba-964924698c44 tempest-VolumesTestJSON-1114536527 None] Lock "cinder-ff445e7b-f476-44d8-b2c1-9615c38c0a62-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:05 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:05 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Flow 'volume_create_manager' (9e21c9fa-3d8f-4482-9e0d-b42661a80a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9805ebf9-5da2-4c07-be1a-c782264341c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9805ebf9-5da2-4c07-be1a-c782264341c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659547290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75bfe56e-4324-4d72-9338-83bb8ace595f,host='devstack@QuobyteHD#QuobyteHD',id=95cce887-7914-4b14-925d-ac4e928cc583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e0ac7b6db442319de68873322a7c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:05Z,use_quota=True,user_id='bca48e1f0e8641118215192c99318d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12e539e2-e8d1-409e-b4a8-fd168f71fed6),volume_type_id=12e539e2-e8d1-409e-b4a8-fd168f71fed6)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4463caea-4d70-4427-ac16-8e931e015884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4463caea-4d70-4427-ac16-8e931e015884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202668fe-71c4-407b-9385-886eefb0a1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202668fe-71c4-407b-9385-886eefb0a1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cce887-7914-4b14-925d-ac4e928cc583', 'volume_name': 'volume-95cce887-7914-4b14-925d-ac4e928cc583', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2443bcb-02a8-46b1-ab91-c3bc4767d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2443bcb-02a8-46b1-ab91-c3bc4767d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc617a73-e7d3-4d83-b554-b49402affeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Volume 95cce887-7914-4b14-925d-ac4e928cc583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cce887-7914-4b14-925d-ac4e928cc583', 'volume_size': 1} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:05 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:05 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a is being set with open permissions: ugo+rw Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:05 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:05 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:05 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:05 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info Sep 22 18:26:05 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:06 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info" returned: 0 in 0.322s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:06 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info is being set with open permissions: ugo+rw Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:06 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info Sep 22 18:26:06 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:06 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.info" returned: 0 in 0.334s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] snapshot: 4cc0a462-f2de-4406-9e2c-a410adde962a, volume: 40731b76-086d-474e-9d25-37288a95221a, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c2e82-12b8-4c4f-82c1-83b63d78604f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:06 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:06 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:07 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.473s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee89b0f-03c4-4979-a285-f49f28d38a34]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:07 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:07 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:07 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.428s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:26:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:07 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a Sep 22 18:26:07 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4b5c97a3-9f43-4220-9520-94f7c04ef0ab tempest-BackendsCapabilitiesAdminTestsJSON-1585968261 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5557746887207, 'free_capacity_gb': 1775.5557746887207, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 18:26:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a31b9a3a-0025-4c51-9b1b-da505768ff7c tempest-BackendsCapabilitiesAdminTestsJSON-1585968261 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5557746887207, 'free_capacity_gb': 1775.5557746887207, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 18:26:15 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a" returned: 0 in 7.769s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:26:15 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Converted 1024.00 MB image at 131.80 MB/s Sep 22 18:26:15 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a is being set with open permissions: ugo+rw Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:15 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a Sep 22 18:26:15 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:15 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" released by "_copy_volume_from_snapshot" :: held 9.033s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-4cc0a462-f2de-4406-9e2c-a410adde962a" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-4cc0a462-f2de-4406-9e2c-a410adde962a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Deleting offline snapshot 4cc0a462-f2de-4406-9e2c-a410adde962a of volume 87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] snapshot_file for this snap is: volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[db059b89-26c6-4268-b198-9d7b8466bcd2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:15 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=137,cinder:SELECT=116,cinder:INSERT=35,cinder:DELETE=6 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:26:15 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:15 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:16 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.465s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d2a97-61c9-459d-a1dc-4f6dd7c68f73]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:16 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:16 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:16 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.585s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:16 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:16 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:17 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.390s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:17 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a Sep 22 18:26:17 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:17 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf.4cc0a462-f2de-4406-9e2c-a410adde962a" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-4cc0a462-f2de-4406-9e2c-a410adde962a" released by "_delete_snapshot" :: held 1.816s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.652s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.114s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=75bfe56e-4324-4d72-9338-83bb8ace595f,created_at=2026-09-22T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659547290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75bfe56e-4324-4d72-9338-83bb8ace595f,host='devstack@QuobyteHD#QuobyteHD',id=95cce887-7914-4b14-925d-ac4e928cc583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e0ac7b6db442319de68873322a7c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:05Z,use_quota=True,user_id='bca48e1f0e8641118215192c99318d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12e539e2-e8d1-409e-b4a8-fd168f71fed6),volume_type_id=12e539e2-e8d1-409e-b4a8-fd168f71fed6)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Creating volume 95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:17 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f21e346-0c0c-4257-91d2-dd2e004eb8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40731b76-086d-474e-9d25-37288a95221a', 'volume_size': 1, 'source_volid': '87c979e5-f69d-41f9-bc8f-4579d0fde1cf', 'source_volstatus': 'available'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c495c224-88c1-45a8-beda-d6521a569bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:17 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 1073741824 Sep 22 18:26:17 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:17 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Volume volume-40731b76-086d-474e-9d25-37288a95221a (40731b76-086d-474e-9d25-37288a95221a): created successfully Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c495c224-88c1-45a8-beda-d6521a569bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (951000fe-4607-44ee-abf7-996690f1f370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4422659f-847a-447b-92f5-b63b4c785f14 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:26:17 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 1073741824" returned: 0 in 0.455s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:17 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 Sep 22 18:26:17 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:18 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583" returned: 0 in 0.277s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc617a73-e7d3-4d83-b554-b49402affeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cce887-7914-4b14-925d-ac4e928cc583', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689b568-3123-47d6-9646-72799d30c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:18 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Volume volume-95cce887-7914-4b14-925d-ac4e928cc583 (95cce887-7914-4b14-925d-ac4e928cc583): created successfully Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689b568-3123-47d6-9646-72799d30c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Flow 'volume_create_manager' (9e21c9fa-3d8f-4482-9e0d-b42661a80a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-17a0f234-7a22-41f6-bdd5-7fd16f1664c2 tempest-GroupSnapshotsV319Test-29709201 None] Created volume successfully. Sep 22 18:26:18 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (e69dc96a-4082-46c4-aa51-48fd6cb9b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187052e-3a8b-49d1-89f3-f4c01318aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187052e-3a8b-49d1-89f3-f4c01318aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128277307',display_name='tempest-VolumesGetTest-Volume-681018704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88140c1c-d9f7-4ae2-b91c-30b8bb48b382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:19Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b64761-c193-490c-a752-e615f490246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b64761-c193-490c-a752-e615f490246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6723689-6e66-4e08-9d59-9f643fd1f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6723689-6e66-4e08-9d59-9f643fd1f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88140c1c-d9f7-4ae2-b91c-30b8bb48b382', 'volume_name': 'volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4d14e-7569-43bc-93a5-a8f8f8c0105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4d14e-7569-43bc-93a5-a8f8f8c0105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1032c1-e14e-4a59-90e9-e1ce675abfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Volume 88140c1c-d9f7-4ae2-b91c-30b8bb48b382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382', 'volume_size': 1} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128277307',display_name='tempest-VolumesGetTest-Volume-681018704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88140c1c-d9f7-4ae2-b91c-30b8bb48b382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:19Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Creating volume 88140c1c-d9f7-4ae2-b91c-30b8bb48b382 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:19 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:19 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 1073741824 Sep 22 18:26:19 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] GroupSnapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: creating. Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Group snapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: creating. {{(pid=86046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Flow 'volume_create_manager' (0f5498de-4e31-4dc7-a0b4-39df9e3ff736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71931d78-cd57-4a59-bac3-b2d9b0ed73e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71931d78-cd57-4a59-bac3-b2d9b0ed73e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-170531715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daafd58-b5b7-4ff7-9077-4cfc735c1425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4060ac26fe4041948555cf86f65e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:20Z,use_quota=True,user_id='6d6ff5b61fc048b3a1dbc88838cb2913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e3e92-3f36-4ab4-a224-b4390ecbaae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e3e92-3f36-4ab4-a224-b4390ecbaae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0b1ab8-65f4-416d-8d15-6a6b24358caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0b1ab8-65f4-416d-8d15-6a6b24358caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3daafd58-b5b7-4ff7-9077-4cfc735c1425', 'volume_name': 'volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce54685-b4ba-4a6e-a0c4-fb839c3e43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce54685-b4ba-4a6e-a0c4-fb839c3e43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:19 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ccb794-a7ed-4cc1-930d-c2895e2f9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:19 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Volume 3daafd58-b5b7-4ff7-9077-4cfc735c1425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425', 'volume_size': 1} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 1073741824" returned: 0 in 0.594s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:19 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 Sep 22 18:26:19 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:19 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1032c1-e14e-4a59-90e9-e1ce675abfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600840e7-0bec-4e11-a0d3-983820e0fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Creating offline snapshot 93c5ab06-255d-4b02-b246-1232911ba182 of volume 95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:26:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Volume volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 (88140c1c-d9f7-4ae2-b91c-30b8bb48b382): created successfully Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600840e7-0bec-4e11-a0d3-983820e0fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (e69dc96a-4082-46c4-aa51-48fd6cb9b318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6cf53e-d6e9-4bf6-be2e-9f04ccb429e4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-493e7bba-5034-48f4-a8f8-eb8e5489cd29 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:26:20 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 Sep 22 18:26:20 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Flow 'volume_create_manager' (339582d5-e3b3-4c47-a598-2a19f5f158f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090d5bb-1bd2-4c94-86e4-1af6b1e23b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090d5bb-1bd2-4c94-86e4-1af6b1e23b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-82722458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f11f54-3709-475b-829b-f2020d8780b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0e73497d2e48408b8c40d9b40d1f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:20Z,use_quota=True,user_id='bd4dd3d178dc433fa9a08835732d4c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9ceef3-f61d-4f49-8222-bcd2ee7794b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9ceef3-f61d-4f49-8222-bcd2ee7794b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fe01d2-2a00-43d1-9318-bd34fcb12d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fe01d2-2a00-43d1-9318-bd34fcb12d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f11f54-3709-475b-829b-f2020d8780b2', 'volume_name': 'volume-45f11f54-3709-475b-829b-f2020d8780b2', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e69c49-b8cf-4fb5-9c06-11209fcd3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e69c49-b8cf-4fb5-9c06-11209fcd3b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7fc440-8b2e-4f85-9b4d-6384f30a0d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Volume 45f11f54-3709-475b-829b-f2020d8780b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f11f54-3709-475b-829b-f2020d8780b2', 'volume_size': 1} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:20 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:20 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 1G Sep 22 18:26:20 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:20 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 1G" returned: 0 in 0.398s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cce887-7914-4b14-925d-ac4e928cc583 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:20 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cce887-7914-4b14-925d-ac4e928cc583 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 Sep 22 18:26:20 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cce887-7914-4b14-925d-ac4e928cc583 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182" returned: 0 in 0.300s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-88140c1c-d9f7-4ae2-b91c-30b8bb48b382-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:21 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 Sep 22 18:26:21 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "cinder-88140c1c-d9f7-4ae2-b91c-30b8bb48b382-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb48bde-36f3-4f23-ab18-a33977c6ff1e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:21 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 Sep 22 18:26:21 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:21 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info Sep 22 18:26:21 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:21 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382 Sep 22 18:26:21 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:21 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info Sep 22 18:26:21 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:21 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-88140c1c-d9f7-4ae2-b91c-30b8bb48b382" released by "delete_volume" :: held 0.677s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Created reservations ['21f987ea-d74c-4b0a-9d48-81c57efd5338', 'ef5b2bd9-d84b-41eb-a81f-889e081ba67a', '1cbe2352-d718-4a58-8153-abae4c3d8b5c', '493cdf8f-d275-49cd-b19f-8c32cbcfce6b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:21 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.info" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-170531715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daafd58-b5b7-4ff7-9077-4cfc735c1425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4060ac26fe4041948555cf86f65e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:20Z,use_quota=True,user_id='6d6ff5b61fc048b3a1dbc88838cb2913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Creating volume 3daafd58-b5b7-4ff7-9077-4cfc735c1425 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:21 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 1073741824 Sep 22 18:26:22 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:22 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-edf7cc6a-5161-4182-9d0e-cb85a60e7368 tempest-GroupSnapshotsV319Test-29709201 None] group_snapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: created successfully Sep 22 18:26:22 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.272s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cbd17b19-346f-4374-814b-469a496e8ed1 tempest-VolumesGetTest-1526341479 None] Lock "cinder-88140c1c-d9f7-4ae2-b91c-30b8bb48b382-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-40731b76-086d-474e-9d25-37288a95221a-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "cinder-40731b76-086d-474e-9d25-37288a95221a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd7df1-de77-46a0-bd2b-3df905f80028]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 1073741824" returned: 0 in 0.543s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 Sep 22 18:26:22 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:22 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a Sep 22 18:26:22 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:22 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425" returned: 0 in 0.285s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.567s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-82722458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f11f54-3709-475b-829b-f2020d8780b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0e73497d2e48408b8c40d9b40d1f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:20Z,use_quota=True,user_id='bd4dd3d178dc433fa9a08835732d4c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Creating volume 45f11f54-3709-475b-829b-f2020d8780b2 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:22 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ccb794-a7ed-4cc1-930d-c2895e2f9815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc0c6b7-53a4-4e3e-b736-8bb2ec9e15de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:22 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 1073741824 Sep 22 18:26:22 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:22 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Volume volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 (3daafd58-b5b7-4ff7-9077-4cfc735c1425): created successfully Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc0c6b7-53a4-4e3e-b736-8bb2ec9e15de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Flow 'volume_create_manager' (0f5498de-4e31-4dc7-a0b4-39df9e3ff736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:22 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a" returned: 0 in 0.430s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fab72300-0d2b-4206-b52e-1cd665b89a24 tempest-VolumesServicesTestJSON-1195684987 None] Created volume successfully. Sep 22 18:26:22 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a Sep 22 18:26:22 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] group_snapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: deleting Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] group_snapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: deleting {{(pid=86046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "cinder-quobyte-93c5ab06-255d-4b02-b246-1232911ba182" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-93c5ab06-255d-4b02-b246-1232911ba182" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Deleting offline snapshot 93c5ab06-255d-4b02-b246-1232911ba182 of volume 95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] snapshot_file for this snap is: volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a424a-ee6e-4aa5-b9bf-309f6df857e6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:23 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-40731b76-086d-474e-9d25-37288a95221a" returned: 0 in 0.309s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-40731b76-086d-474e-9d25-37288a95221a" released by "delete_volume" :: held 0.790s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:23 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 Sep 22 18:26:23 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Created reservations ['b1e3f736-7954-4272-b7b2-32200c360d20', '5e59cceb-e8fe-4590-994c-c19010eeb29d', '68147fda-aef5-449e-859e-574fc1b57091', '497966a6-3804-42b5-acc1-5edded346e62'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:23 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 1073741824" returned: 0 in 0.567s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:23 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:23 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:23 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 Sep 22 18:26:23 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:23 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182" returned: 0 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95cce887-7914-4b14-925d-ac4e928cc583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3dc4d-c73a-40f9-b9d3-4ac42e6b95db]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-87c979e5-f69d-41f9-bc8f-4579d0fde1cf-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "cinder-87c979e5-f69d-41f9-bc8f-4579d0fde1cf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:23 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73ce4c5a-bce3-4be5-bb3c-6f61fca587ed tempest-VolumesGetTest-1526341479 None] Lock "cinder-40731b76-086d-474e-9d25-37288a95221a-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:23 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:23 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 Sep 22 18:26:23 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2" returned: 0 in 0.412s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7fc440-8b2e-4f85-9b4d-6384f30a0d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f11f54-3709-475b-829b-f2020d8780b2', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e119fb-f0d8-4385-bf22-af3d7eb3123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da00f8-283d-4aa2-b2a9-27438599eb15]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Volume volume-45f11f54-3709-475b-829b-f2020d8780b2 (45f11f54-3709-475b-829b-f2020d8780b2): created successfully Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e119fb-f0d8-4385-bf22-af3d7eb3123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Flow 'volume_create_manager' (339582d5-e3b3-4c47-a598-2a19f5f158f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f4756c1e-8d44-4eca-a59b-35336204133f tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Created volume successfully. Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Acquiring lock "cinder-3daafd58-b5b7-4ff7-9077-4cfc735c1425-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:24 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:24 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "cinder-3daafd58-b5b7-4ff7-9077-4cfc735c1425-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Acquiring lock "cinder-quobyte-3daafd58-b5b7-4ff7-9077-4cfc735c1425" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "cinder-quobyte-3daafd58-b5b7-4ff7-9077-4cfc735c1425" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[75280b31-0d4f-48a0-8b6e-a04f3f99da7a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583" returned: 0 in 0.503s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 Sep 22 18:26:24 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 Sep 22 18:26:24 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.442s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf Sep 22 18:26:24 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182" returned: 0 in 0.391s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425" returned: 0 in 0.426s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182 Sep 22 18:26:24 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425 Sep 22 18:26:24 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:24 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" returned: 0 in 0.320s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-87c979e5-f69d-41f9-bc8f-4579d0fde1cf" released by "delete_volume" :: held 0.879s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Created reservations ['cdde506d-b474-46d6-aee0-57525b4415b2', 'd030706b-4d1a-4007-91fc-035a1823fd8a', '5cf8ae84-9837-435d-a387-621c244cd188', 'aefbf6b0-0e04-4074-bce3-8db9984662eb'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:24 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:24 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583.93c5ab06-255d-4b02-b246-1232911ba182" returned: 0 in 0.393s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:24 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:25 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3daafd58-b5b7-4ff7-9077-4cfc735c1425" returned: 0 in 0.437s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-93c5ab06-255d-4b02-b246-1232911ba182" released by "_delete_snapshot" :: held 1.904s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "cinder-quobyte-3daafd58-b5b7-4ff7-9077-4cfc735c1425" released by "delete_volume" :: held 0.928s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" released by "delete_snapshot" :: held 1.948s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Created reservations ['c94c1fef-615f-4271-bc7d-324538c5c9ba', '96715b7c-4be1-4cab-b30b-64253b4f5d67', 'ae26177c-bc80-4202-84d3-d39072a8322c', '2c872840-4903-490c-92a9-fa14cd473758'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:25 devstack cinder-volume[86046]: WARNING cinder.quota [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1329443673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1329443673, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:26:25 devstack cinder-volume[86046]: WARNING cinder.quota [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1329443673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1329443673, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] Created reservations ['b504324f-bc13-4ff3-84b8-611ffda1c9de', 'c1fda933-078a-42c6-b195-c66de6bd1c18', 'b26e5ac3-cb17-486c-8248-c31a5281446b', 'fbcb304f-1acd-4e26-8a86-08c96031022d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:25 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.426s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:25 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:25 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-212e1bb0-c417-4090-954b-f7a752755986 tempest-VolumesGetTest-1526341479 None] Lock "cinder-87c979e5-f69d-41f9-bc8f-4579d0fde1cf-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-928bfb2d-fb29-4770-9e1b-eea2d76cdb4b tempest-GroupSnapshotsV319Test-29709201 None] group_snapshot 205f2d63-eb3a-44cf-b870-4627c28070dc: deleted successfully Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2e502086-9d12-4018-92bf-3f0e62512a57 req-0284d630-23ed-4c0b-8358-b729a83ed48c tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2e502086-9d12-4018-92bf-3f0e62512a57 req-0284d630-23ed-4c0b-8358-b729a83ed48c tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-2e502086-9d12-4018-92bf-3f0e62512a57 req-0284d630-23ed-4c0b-8358-b729a83ed48c tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-2e502086-9d12-4018-92bf-3f0e62512a57 req-0284d630-23ed-4c0b-8358-b729a83ed48c tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-45f11f54-3709-475b-829b-f2020d8780b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd197b210-6d36-48e0-8712-253631818d29', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:26:25 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.373s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Deleted volume successfully. Sep 22 18:26:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-2e502086-9d12-4018-92bf-3f0e62512a57 req-0284d630-23ed-4c0b-8358-b729a83ed48c tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] attachment_update completed successfully. Sep 22 18:26:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7ae3a51e-8b39-480f-9bb9-16170d961bde tempest-VolumesServicesTestJSON-1195684987 None] Lock "cinder-3daafd58-b5b7-4ff7-9077-4cfc735c1425-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (75da3bd2-bcef-44d6-a245-67eec2a427ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df70fad0-578d-42e9-8363-9e73a91b3864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df70fad0-578d-42e9-8363-9e73a91b3864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-472481289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb21d476-5b0d-470e-b67c-c693b03df0ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:26Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e5cf5-70a2-4b65-b0d0-4c4d40053242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3e5cf5-70a2-4b65-b0d0-4c4d40053242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca495e-46bb-4f7f-89fc-064680459431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca495e-46bb-4f7f-89fc-064680459431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb21d476-5b0d-470e-b67c-c693b03df0ba', 'volume_name': 'volume-bb21d476-5b0d-470e-b67c-c693b03df0ba', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6c7d2-9d0f-461e-8df6-770372eab867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6c7d2-9d0f-461e-8df6-770372eab867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572436f3-b468-4f5a-abc1-1e4e80746ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Volume bb21d476-5b0d-470e-b67c-c693b03df0ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb21d476-5b0d-470e-b67c-c693b03df0ba', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Trying to clone bb21d476-5b0d-470e-b67c-c693b03df0ba from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" acquired by "delete_volume" :: waited 0.037s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b0336-16fe-4a06-9f5c-1512ecee132a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:26:27 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Image download 20.69 MB at 20.69 MB/s Sep 22 18:26:27 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 Sep 22 18:26:27 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664690d-3607-422e-9a45-7f1583e5d75b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:27 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD Sep 22 18:26:27 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:27 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583" returned: 0 in 0.509s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:27 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583 Sep 22 18:26:27 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:27 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 is fetched for user b17ed4a6bc7f49ad99d450475d2cc3ec. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012ce41-d167-4f35-8b7b-e72289f89951]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:27 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-95cce887-7914-4b14-925d-ac4e928cc583" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Lock "cinder-quobyte-95cce887-7914-4b14-925d-ac4e928cc583" released by "delete_volume" :: held 0.922s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Created reservations ['9b4967a9-52fd-47b6-bb8e-a62e849d34ff'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:27 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD Sep 22 18:26:27 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:27 devstack cinder-volume[86046]: WARNING cinder.quota [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1329443673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1329443673, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:26:27 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Created reservations ['f8310c1c-b09b-4515-a43c-3101ff1cc771', 'e22aea0e-3136-469f-a950-4d5272700a2f', 'ebf06d20-1145-43e7-a8dd-69837d20c3a6', 'd87b6e7f-a02c-459c-925e-6e2d65326917'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:28 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:28 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:28 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-472481289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb21d476-5b0d-470e-b67c-c693b03df0ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:26Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Creating volume bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:28 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:28 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1073741824 Sep 22 18:26:28 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:28 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:28 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-72af6214-beb9-4c9d-95ab-2792002708d0 tempest-GroupSnapshotsV319Test-29709201 None] Delete group completed successfully. Sep 22 18:26:28 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1073741824" returned: 0 in 0.615s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:28 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba Sep 22 18:26:28 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:29 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Attempting download of 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume bb21d476-5b0d-470e-b67c-c693b03df0ba. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473f46c-7158-41f7-acdd-4ce4c705a9d6]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:29 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33 Sep 22 18:26:29 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-6bcc7537-9b85-4964-b8ba-df16225e747d req-01207d47-aa6f-43ba-a60d-6bd9f2e7f26d tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Terminate volume connection completed successfully. Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-6bcc7537-9b85-4964-b8ba-df16225e747d req-01207d47-aa6f-43ba-a60d-6bd9f2e7f26d tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Deleting attachment d197b210-6d36-48e0-8712-253631818d29. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:26:29 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33" returned: 0 in 0.520s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:29 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33 Sep 22 18:26:30 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:30 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33" returned: 1 in 0.367s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_44xz9d33' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20939dc-5834-4908-a61e-f9ba3430d460]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:30 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD Sep 22 18:26:30 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "cinder-45f11f54-3709-475b-829b-f2020d8780b2-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "cinder-45f11f54-3709-475b-829b-f2020d8780b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "cinder-quobyte-45f11f54-3709-475b-829b-f2020d8780b2" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "cinder-quobyte-45f11f54-3709-475b-829b-f2020d8780b2" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6e28a-57ff-486b-8bff-adae0dcf6829]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:30 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:26:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:30 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba Sep 22 18:26:30 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 Sep 22 18:26:30 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:30 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:31 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2" returned: 0 in 0.513s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:31 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2 Sep 22 18:26:31 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:31 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-45f11f54-3709-475b-829b-f2020d8780b2" returned: 0 in 0.371s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "cinder-quobyte-45f11f54-3709-475b-829b-f2020d8780b2" released by "delete_volume" :: held 0.954s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Created reservations ['93c3e9be-17a3-4416-9ce9-3b0f7a408dc7', 'b96d422f-37b7-4177-aa80-e42781b0c3aa', '13d1b068-1d3f-4926-ba5e-b39e7f2a5ba2', '1852f7d1-ddab-472c-9027-69a92aa2722b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:31 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:31 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:32 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:32 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Deleted volume successfully. Sep 22 18:26:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-04715542-84a6-4a76-b32a-80ed0b9c6983 tempest-TestServerVolumeAttachScenarioOldVersion-1300894440 None] Lock "cinder-45f11f54-3709-475b-829b-f2020d8780b2-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:33 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba" returned: 0 in 2.770s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:33 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_cqbvgys4devstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:26:33 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Converted 112.00 MB image at 40.41 MB/s Sep 22 18:26:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:33 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1G Sep 22 18:26:33 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:34 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba 1G" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Downloaded image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume bb21d476-5b0d-470e-b67c-c693b03df0ba successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 for user b17ed4a6bc7f49ad99d450475d2cc3ec is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Marking volume bb21d476-5b0d-470e-b67c-c693b03df0ba as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Copying metadata from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 to bb21d476-5b0d-470e-b67c-c693b03df0ba. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Creating volume glance metadata for volume bb21d476-5b0d-470e-b67c-c693b03df0ba backed by image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=166,cinder:UPDATE=227,cinder:INSERT=55,cinder:DELETE=14 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572436f3-b468-4f5a-abc1-1e4e80746ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb21d476-5b0d-470e-b67c-c693b03df0ba', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c37913-b612-4ef3-8867-4cbb45864f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Volume volume-bb21d476-5b0d-470e-b67c-c693b03df0ba (bb21d476-5b0d-470e-b67c-c693b03df0ba): created successfully Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c37913-b612-4ef3-8867-4cbb45864f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (75da3bd2-bcef-44d6-a245-67eec2a427ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d84a0401-1c1d-496e-aa59-74820cbae084 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Flow 'volume_create_manager' (f729b85f-8bef-466c-aa7a-16570f25d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddea99d-b30b-4beb-b47c-0aefe5b50f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddea99d-b30b-4beb-b47c-0aefe5b50f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-104107250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e24265-cdb7-4a12-b889-f3026bc5c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e3ede4b02470c9fa2d649ca44395b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:35Z,use_quota=True,user_id='5894bb8d743345a6a106377919311cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab6e56-6c02-4055-869e-2179ad2a6997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab6e56-6c02-4055-869e-2179ad2a6997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60651187-6fc0-4cb9-855e-e8904a30b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60651187-6fc0-4cb9-855e-e8904a30b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e24265-cdb7-4a12-b889-f3026bc5c8c5', 'volume_name': 'volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d823a0a5-8410-406c-a3ea-58cd22ddb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d823a0a5-8410-406c-a3ea-58cd22ddb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7e70ac-37f9-4dca-815a-e118d220a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Volume 28e24265-cdb7-4a12-b889-f3026bc5c8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5', 'volume_size': 1} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-104107250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e24265-cdb7-4a12-b889-f3026bc5c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e3ede4b02470c9fa2d649ca44395b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:35Z,use_quota=True,user_id='5894bb8d743345a6a106377919311cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Creating volume 28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:34 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:34 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 1073741824 Sep 22 18:26:34 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:35 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 1073741824" returned: 0 in 0.736s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:35 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 Sep 22 18:26:35 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (41ed4156-5010-46d2-949c-48623197cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3a860-4585-4635-ac14-1d36355c1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3a860-4585-4635-ac14-1d36355c1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45339363',display_name='tempest-VolumesGetTest-Volume-85182718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54798bd8-021c-4155-96dd-34a7a1655a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:36Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bd4ee4-afec-4052-bdd3-a0ce98457186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bd4ee4-afec-4052-bdd3-a0ce98457186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e782ea7-3efe-4355-b72f-8be9069d40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e782ea7-3efe-4355-b72f-8be9069d40c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54798bd8-021c-4155-96dd-34a7a1655a64', 'volume_name': 'volume-54798bd8-021c-4155-96dd-34a7a1655a64', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b098712-2996-4aa9-8ce8-c3ba67db6f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b098712-2996-4aa9-8ce8-c3ba67db6f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca3a662-2986-42ea-b80a-cc26c301ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Volume 54798bd8-021c-4155-96dd-34a7a1655a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54798bd8-021c-4155-96dd-34a7a1655a64', 'volume_size': 1} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:36 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5" returned: 0 in 0.407s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45339363',display_name='tempest-VolumesGetTest-Volume-85182718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54798bd8-021c-4155-96dd-34a7a1655a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edd506a0b974bde8f77d1a0a98d7cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:36Z,use_quota=True,user_id='b17ed4a6bc7f49ad99d450475d2cc3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Creating volume 54798bd8-021c-4155-96dd-34a7a1655a64 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:36 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:36 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 1073741824 Sep 22 18:26:36 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7e70ac-37f9-4dca-815a-e118d220a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd4c1e6-5ffd-4688-8bbf-e896f979399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Volume volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 (28e24265-cdb7-4a12-b889-f3026bc5c8c5): created successfully Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd4c1e6-5ffd-4688-8bbf-e896f979399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Flow 'volume_create_manager' (f729b85f-8bef-466c-aa7a-16570f25d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1215668a-49a8-4741-83d1-ae62dfe5d2be tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Created volume successfully. Sep 22 18:26:36 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 1073741824" returned: 0 in 0.524s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:36 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 Sep 22 18:26:36 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:36 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64" returned: 0 in 0.342s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca3a662-2986-42ea-b80a-cc26c301ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54798bd8-021c-4155-96dd-34a7a1655a64', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26762b3d-31c7-414b-9abd-c8977e49d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:37 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Volume volume-54798bd8-021c-4155-96dd-34a7a1655a64 (54798bd8-021c-4155-96dd-34a7a1655a64): created successfully Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26762b3d-31c7-414b-9abd-c8977e49d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Flow 'volume_create_manager' (41ed4156-5010-46d2-949c-48623197cd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6aa11891-ade2-43aa-a239-867dda2b1cc5 tempest-VolumesGetTest-1526341479 None] Created volume successfully. Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Creating offline snapshot 81973cc7-16e6-4add-81b9-1ba559c7ad36 of volume 28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034c777-f62a-4e03-9e0c-aa0a52c5f2ec]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:37 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 Sep 22 18:26:37 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:37 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5" returned: 0 in 0.423s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:37 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 1G Sep 22 18:26:37 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-54798bd8-021c-4155-96dd-34a7a1655a64-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:38 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 1G" returned: 0 in 0.655s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "cinder-54798bd8-021c-4155-96dd-34a7a1655a64-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:38 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 Sep 22 18:26:38 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-54798bd8-021c-4155-96dd-34a7a1655a64" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-54798bd8-021c-4155-96dd-34a7a1655a64" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e73d29-5788-4df9-92cf-3c08fab64835]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:38 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 Sep 22 18:26:38 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:38 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36" returned: 0 in 0.415s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:38 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 is being set with open permissions: ugo+rw Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:38 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 Sep 22 18:26:38 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:38 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64" returned: 0 in 0.434s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:38 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64 Sep 22 18:26:38 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:38 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36" returned: 0 in 0.314s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:39 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info Sep 22 18:26:39 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:39 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-54798bd8-021c-4155-96dd-34a7a1655a64" returned: 0 in 0.330s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-54798bd8-021c-4155-96dd-34a7a1655a64" released by "delete_volume" :: held 0.870s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Created reservations ['36674696-ad16-4e6f-9505-ca5f5ff0b6d5', '69a45002-cdc2-40c3-9eaa-fe1f9791143f', '594a3199-cdef-42e5-a4f1-eb314c0d26dc', '5aa6faec-47b6-4059-8cae-9eee927a2f6c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:39 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info" returned: 0 in 0.337s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info is being set with open permissions: ugo+rw Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:39 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info Sep 22 18:26:39 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:39 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:39 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-bb21d476-5b0d-470e-b67c-c693b03df0ba-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "cinder-bb21d476-5b0d-470e-b67c-c693b03df0ba-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Acquiring lock "cinder-quobyte-bb21d476-5b0d-470e-b67c-c693b03df0ba" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-bb21d476-5b0d-470e-b67c-c693b03df0ba" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:39 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.info" returned: 0 in 0.434s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d4aa0-981d-4adf-a0e4-573306c24f22]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:39 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-376586ef-a2f2-4e43-b6ba-20fe2b10f642 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Create snapshot completed successfully Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.465s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:39 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba Sep 22 18:26:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d2346ce4-1af5-43ea-a8b2-af3fd601d4fc tempest-VolumesGetTest-1526341479 None] Lock "cinder-54798bd8-021c-4155-96dd-34a7a1655a64-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:39 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:40 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:40 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba Sep 22 18:26:40 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:40 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb21d476-5b0d-470e-b67c-c693b03df0ba" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "cinder-quobyte-bb21d476-5b0d-470e-b67c-c693b03df0ba" released by "delete_volume" :: held 0.876s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Created reservations ['9e4f5f6f-078f-4b57-b825-a77283b73594', '4d2300a9-8fc1-4643-b296-63a6b5ea5122', '5eb0eb4b-ddbd-4487-8c18-c6c5a86ebd94', 'a8782eef-9466-4a26-ae18-ad276ac4ae23'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:40 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:40 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "cinder-81973cc7-16e6-4add-81b9-1ba559c7ad36-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-81973cc7-16e6-4add-81b9-1ba559c7ad36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "cinder-quobyte-81973cc7-16e6-4add-81b9-1ba559c7ad36" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-81973cc7-16e6-4add-81b9-1ba559c7ad36" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Deleting offline snapshot 81973cc7-16e6-4add-81b9-1ba559c7ad36 of volume 28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] snapshot_file for this snap is: volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:26:41 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d769f37f-7c08-453c-a83c-00f9e5bff5a4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Deleted volume successfully. Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7a94894d-0b13-4894-9631-6f10af2de9fe tempest-VolumesGetTest-1526341479 None] Lock "cinder-bb21d476-5b0d-470e-b67c-c693b03df0ba-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:41 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 Sep 22 18:26:41 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:41 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36" returned: 0 in 0.392s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66a6c6-790a-4e30-9991-319a73570306]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:41 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 Sep 22 18:26:41 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:42 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5" returned: 0 in 0.490s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:42 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 Sep 22 18:26:42 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:42 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36" returned: 0 in 0.484s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:42 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36 Sep 22 18:26:42 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:42 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5.81973cc7-16e6-4add-81b9-1ba559c7ad36" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-81973cc7-16e6-4add-81b9-1ba559c7ad36" released by "_delete_snapshot" :: held 1.931s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" released by "delete_snapshot" :: held 1.964s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:43 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Created reservations ['4e0dbf0e-fb50-4059-b55c-238ac2324ab7', '1b435311-48b8-4334-8563-38419b7a3010', '01a1dcab-8196-4e6b-9614-8f587a0186b4', 'af295514-090b-48f8-87f6-8df6694474ad'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Delete snapshot completed successfully. Sep 22 18:26:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ad7176e7-97e8-41ad-9b7b-9c90e34695d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-81973cc7-16e6-4add-81b9-1ba559c7ad36-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "cinder-28e24265-cdb7-4a12-b889-f3026bc5c8c5-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-28e24265-cdb7-4a12-b889-f3026bc5c8c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa673326-d5f7-4a2e-9fc3-698a8f159b39]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:44 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 Sep 22 18:26:44 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:45 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5" returned: 0 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:45 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5 Sep 22 18:26:45 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:45 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-28e24265-cdb7-4a12-b889-f3026bc5c8c5" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-quobyte-28e24265-cdb7-4a12-b889-f3026bc5c8c5" released by "delete_volume" :: held 0.874s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Created reservations ['9ad4f06b-5aa1-4489-8145-9113738eceff', 'eb621b1f-157a-4855-b615-5900c8969c90', 'f2a7df8b-d380-4201-a78e-fa6ace1c1d4f', '38588b24-2048-4cad-97bf-9ee14c5fff0d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:45 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:26:45 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:45 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.329s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:26:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Deleted volume successfully. Sep 22 18:26:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb4aca88-b731-4d3b-8438-c372fe04fa52 tempest-VolumeSnapshotQuotasNegativeTestJSON-325733111 None] Lock "cinder-28e24265-cdb7-4a12-b889-f3026bc5c8c5-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:26:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7ddfea11-6ce9-4e26-8658-88f06d6e1d94 tempest-GroupsV314Test-792226545 None] Group tempest-GroupsV314Test-Group-1661887729: creating Sep 22 18:26:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7ddfea11-6ce9-4e26-8658-88f06d6e1d94 tempest-GroupsV314Test-792226545 None] Group tempest-GroupsV314Test-Group-1661887729: created successfully Sep 22 18:26:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7ddfea11-6ce9-4e26-8658-88f06d6e1d94 tempest-GroupsV314Test-792226545 None] Create group completed successfully. Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (e1036f76-7055-45c9-8219-a80457949723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815b1a0-2555-41d7-a6ed-4d2736a42855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815b1a0-2555-41d7-a6ed-4d2736a42855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1495708502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47a8f3-4a32-44da-b272-5a79586bafe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:48Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d45cc3-2c8d-4b0e-b083-a0777a1f8332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d45cc3-2c8d-4b0e-b083-a0777a1f8332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12746868-4483-4310-b982-575a3d1690bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12746868-4483-4310-b982-575a3d1690bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c47a8f3-4a32-44da-b272-5a79586bafe4', 'volume_name': 'volume-9c47a8f3-4a32-44da-b272-5a79586bafe4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e31f85c-7ecd-44b1-9d1f-773435b0845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e31f85c-7ecd-44b1-9d1f-773435b0845a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d23b1f1-a0dc-4622-a337-09c1e5332620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Volume 9c47a8f3-4a32-44da-b272-5a79586bafe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c47a8f3-4a32-44da-b272-5a79586bafe4', 'volume_size': 1} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1495708502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47a8f3-4a32-44da-b272-5a79586bafe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:48Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Creating volume 9c47a8f3-4a32-44da-b272-5a79586bafe4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:48 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:48 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 1073741824 Sep 22 18:26:48 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Flow 'volume_create_manager' (52d7cef1-ca72-456f-9270-ade4ab3144ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845cfabd-2517-4163-82ae-704339a4f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845cfabd-2517-4163-82ae-704339a4f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184756271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7384bc94-5e63-42f2-9c7d-bd3b3b9b8eb3,host='devstack@QuobyteHD#QuobyteHD',id=ff6a1ff0-5116-4a38-98b0-68da9d6cd640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46805d7620ea4d1182288226fbf7efdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:48Z,use_quota=True,user_id='f3270396af2a416888ead18b225d0aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1c677b5-4bc1-4be2-8c0a-e73757c6d6ed),volume_type_id=a1c677b5-4bc1-4be2-8c0a-e73757c6d6ed)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec04c17-0c1a-4a50-9438-bbf0caad3860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec04c17-0c1a-4a50-9438-bbf0caad3860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c4eb8-a2df-4631-88eb-d0de2b99dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635c4eb8-a2df-4631-88eb-d0de2b99dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6a1ff0-5116-4a38-98b0-68da9d6cd640', 'volume_name': 'volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e66e13c-6828-446c-a00d-8ccccf7cc1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e66e13c-6828-446c-a00d-8ccccf7cc1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5296dd6-0edb-420e-9553-c755bc4f7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Volume ff6a1ff0-5116-4a38-98b0-68da9d6cd640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640', 'volume_size': 1} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:26:48 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 1073741824" returned: 0 in 0.546s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:49 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 Sep 22 18:26:49 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:49 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4" returned: 0 in 0.373s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7384bc94-5e63-42f2-9c7d-bd3b3b9b8eb3,created_at=2026-09-22T16:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184756271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7384bc94-5e63-42f2-9c7d-bd3b3b9b8eb3,host='devstack@QuobyteHD#QuobyteHD',id=ff6a1ff0-5116-4a38-98b0-68da9d6cd640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46805d7620ea4d1182288226fbf7efdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:48Z,use_quota=True,user_id='f3270396af2a416888ead18b225d0aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1c677b5-4bc1-4be2-8c0a-e73757c6d6ed),volume_type_id=a1c677b5-4bc1-4be2-8c0a-e73757c6d6ed)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Creating volume ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:49 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d23b1f1-a0dc-4622-a337-09c1e5332620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c47a8f3-4a32-44da-b272-5a79586bafe4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:49 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 1073741824 Sep 22 18:26:49 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac43b8c-e507-4a51-aec4-a8430a5ebc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Volume volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 (9c47a8f3-4a32-44da-b272-5a79586bafe4): created successfully Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac43b8c-e507-4a51-aec4-a8430a5ebc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (e1036f76-7055-45c9-8219-a80457949723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1a274423-6c47-44e5-8d0d-01d0037307cb tempest-VolumesListTestJSON-652977927 None] Created volume successfully. Sep 22 18:26:49 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 1073741824" returned: 0 in 0.553s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:50 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:26:50 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:50 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5296dd6-0edb-420e-9553-c755bc4f7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa92e1e-7192-4143-aab0-9b4cf06d0794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Volume volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 (ff6a1ff0-5116-4a38-98b0-68da9d6cd640): created successfully Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa92e1e-7192-4143-aab0-9b4cf06d0794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Flow 'volume_create_manager' (52d7cef1-ca72-456f-9270-ade4ab3144ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b5e1d6de-a430-464a-9333-9fd1a44b5a4a tempest-GroupsV314Test-792226545 None] Created volume successfully. Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (6b6e155e-2b11-42de-a975-409b7c28556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf26075-5638-4e76-aa81-cc57134efe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf26075-5638-4e76-aa81-cc57134efe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1956569708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61247ad-1a85-4adb-9868-de648a17f72c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:51Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f481fd-0f9f-4d8f-ad01-a0b6a68db2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f481fd-0f9f-4d8f-ad01-a0b6a68db2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c989e7-1acb-4f3f-aa62-27b0bf4167e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c989e7-1acb-4f3f-aa62-27b0bf4167e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61247ad-1a85-4adb-9868-de648a17f72c', 'volume_name': 'volume-f61247ad-1a85-4adb-9868-de648a17f72c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9586e206-06c6-4756-b194-43864117f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9586e206-06c6-4756-b194-43864117f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474d1ce-34c0-453d-9a6e-6694afbe57ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Volume f61247ad-1a85-4adb-9868-de648a17f72c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61247ad-1a85-4adb-9868-de648a17f72c', 'volume_size': 1} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1956569708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61247ad-1a85-4adb-9868-de648a17f72c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:51Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Creating volume f61247ad-1a85-4adb-9868-de648a17f72c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:26:50 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:26:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:50 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c 1073741824 Sep 22 18:26:50 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:51 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c 1073741824" returned: 0 in 0.533s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:51 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c Sep 22 18:26:51 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:51 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474d1ce-34c0-453d-9a6e-6694afbe57ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61247ad-1a85-4adb-9868-de648a17f72c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549501cc-40ec-4ef6-b464-7f6bde0d5551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:51 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Volume volume-f61247ad-1a85-4adb-9868-de648a17f72c (f61247ad-1a85-4adb-9868-de648a17f72c): created successfully Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549501cc-40ec-4ef6-b464-7f6bde0d5551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:51 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (6b6e155e-2b11-42de-a975-409b7c28556a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1a998433-eead-4d27-98ef-f728deeb6754 tempest-VolumesListTestJSON-652977927 None] Created volume successfully. Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:52 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Cloning volume ff6a1ff0-5116-4a38-98b0-68da9d6cd640 to volume 054bc8fd-a646-4248-adaf-6ce2cd2be865 Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Creating offline snapshot 24579be7-4983-4e32-bf47-df84d5b84301 of volume ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[36faed8e-22a4-410e-b343-4922ef7af55f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:52 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:26:52 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:52 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.466s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:52 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 1G Sep 22 18:26:52 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (f3826a78-ab9b-4763-9792-195edffd37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5a66c1-69c8-4961-a6d9-7f4ec2aa6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:53 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 1G" returned: 0 in 0.602s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5a66c1-69c8-4961-a6d9-7f4ec2aa6530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1928779917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ad758d-d18f-4cb9-9347-8c3af651057c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:53Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64f9d90-cf1d-43f6-9dd6-32a147af24d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:53 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:26:53 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64f9d90-cf1d-43f6-9dd6-32a147af24d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99df6bcb-1150-4113-85e3-ea94ac45ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99df6bcb-1150-4113-85e3-ea94ac45ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ad758d-d18f-4cb9-9347-8c3af651057c', 'volume_name': 'volume-d5ad758d-d18f-4cb9-9347-8c3af651057c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e97972b-db2d-49be-8df5-46c1979a3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e97972b-db2d-49be-8df5-46c1979a3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcb39fb-f762-441c-8cc9-7be0a6fba489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:26:53 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Volume d5ad758d-d18f-4cb9-9347-8c3af651057c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ad758d-d18f-4cb9-9347-8c3af651057c', 'volume_size': 1} Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:53 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.401s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:53 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:26:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:53 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:26:53 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:54 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.321s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:54 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info Sep 22 18:26:54 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:54 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:54 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:54 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info Sep 22 18:26:54 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:54 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.info" returned: 0 in 0.281s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Acquiring lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] snapshot: 24579be7-4983-4e32-bf47-df84d5b84301, volume: 054bc8fd-a646-4248-adaf-6ce2cd2be865, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8366d7-e490-43c2-8a1d-c321ba68e5a8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:55 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:26:55 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:55 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.426s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b7dcbc-56f5-451c-9665-d6846d593804]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:55 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:26:55 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:26:55 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.418s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:26:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:26:55 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 Sep 22 18:26:55 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Flow 'volume_create_manager' (fe85ecd5-8992-403a-8691-b8d3309df348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa413fb5-47f9-49fc-99ba-7e7f05325589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa413fb5-47f9-49fc-99ba-7e7f05325589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-433214759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b55beb4-660a-415e-9b8d-86b6cc7e53cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2929ae1b4378447981cdad9e10e08733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:04Z,use_quota=True,user_id='bd3900ed4f3e4b62857d04330b180a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250f2a8d-7518-443e-b99e-5d62e53289fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250f2a8d-7518-443e-b99e-5d62e53289fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a9aca-c054-4441-accb-e7c1f8efe4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24a9aca-c054-4441-accb-e7c1f8efe4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b55beb4-660a-415e-9b8d-86b6cc7e53cc', 'volume_name': 'volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78920ed-afb4-4166-85ee-10dba1b53458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78920ed-afb4-4166-85ee-10dba1b53458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709d1951-7062-4c75-94b1-8e2294688cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Volume 5b55beb4-660a-415e-9b8d-86b6cc7e53cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc', 'volume_size': 1} Sep 22 18:27:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:04 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865" returned: 0 in 8.660s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:27:04 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Converted 1024.00 MB image at 118.24 MB/s Sep 22 18:27:04 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 is being set with open permissions: ugo+rw: NotImplementedError Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:04 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 Sep 22 18:27:04 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:04 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865" returned: 0 in 0.275s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" released by "_copy_volume_from_snapshot" :: held 9.894s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Acquiring lock "cinder-quobyte-24579be7-4983-4e32-bf47-df84d5b84301" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-24579be7-4983-4e32-bf47-df84d5b84301" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Deleting offline snapshot 24579be7-4983-4e32-bf47-df84d5b84301 of volume ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] snapshot_file for this snap is: volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4dca16-32e4-474b-adcd-0973a2dbade3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:04 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:27:04 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:05 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.401s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:27:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c5428-ce31-4f8c-a2e3-114b08109988]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:05 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:27:05 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:06 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.714s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:06 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:27:06 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:06 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:06 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301 Sep 22 18:27:06 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:06 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640.24579be7-4983-4e32-bf47-df84d5b84301" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-24579be7-4983-4e32-bf47-df84d5b84301" released by "_delete_snapshot" :: held 1.884s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.360s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.155s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1928779917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ad758d-d18f-4cb9-9347-8c3af651057c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef5f80aa3f864e358c65463b29c621e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:26:53Z,use_quota=True,user_id='b01b901ca4fb4645a1147b3578224b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Creating volume d5ad758d-d18f-4cb9-9347-8c3af651057c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:06 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:06 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c 1073741824 Sep 22 18:27:06 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-45a6fe89-055b-44d7-b8a3-13f98cc7aff9 tempest-GroupsV314Test-792226545 None] Create group from source-group-7384bc94-5e63-42f2-9c7d-bd3b3b9b8eb3 completed successfully. Sep 22 18:27:07 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c 1073741824" returned: 0 in 0.523s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:07 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c Sep 22 18:27:07 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:07 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.686s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-433214759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b55beb4-660a-415e-9b8d-86b6cc7e53cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2929ae1b4378447981cdad9e10e08733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:04Z,use_quota=True,user_id='bd3900ed4f3e4b62857d04330b180a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Creating volume 5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:07 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcb39fb-f762-441c-8cc9-7be0a6fba489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ad758d-d18f-4cb9-9347-8c3af651057c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:07 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc 1073741824 Sep 22 18:27:07 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c7d55-cba8-43c8-b268-1a93138b4987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Volume volume-d5ad758d-d18f-4cb9-9347-8c3af651057c (d5ad758d-d18f-4cb9-9347-8c3af651057c): created successfully Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c7d55-cba8-43c8-b268-1a93138b4987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Flow 'volume_create_manager' (f3826a78-ab9b-4763-9792-195edffd37f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5c436bba-d69c-4746-823c-6f659999a826 tempest-VolumesListTestJSON-652977927 None] Created volume successfully. Sep 22 18:27:08 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc 1073741824" returned: 0 in 0.678s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:08 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc Sep 22 18:27:08 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:08 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" returned: 0 in 0.327s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709d1951-7062-4c75-94b1-8e2294688cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15732f1-4418-4ccd-aa5a-0ba168c5b510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:08 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Volume volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc (5b55beb4-660a-415e-9b8d-86b6cc7e53cc): created successfully Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15732f1-4418-4ccd-aa5a-0ba168c5b510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Flow 'volume_create_manager' (fe85ecd5-8992-403a-8691-b8d3309df348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a16870e9-70b7-46e5-bec0-c146218817c3 tempest-SnapshotMetadataTestJSON-1617629946 None] Created volume successfully. Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Acquiring lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac898e9-81ab-4d4b-898e-b8c91d14a295]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:08 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 Sep 22 18:27:08 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Creating offline snapshot f7212fed-3e17-48a6-bfbf-70bdec67ecc2 of volume 5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:27:09 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865" returned: 0 in 0.498s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3255bd8-1a58-46b9-aa97-2f56716332bf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:09 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865 Sep 22 18:27:09 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:09 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc Sep 22 18:27:09 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:09 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-054bc8fd-a646-4248-adaf-6ce2cd2be865" returned: 0 in 0.307s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-054bc8fd-a646-4248-adaf-6ce2cd2be865" released by "delete_volume" :: held 0.864s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Created reservations ['a3446c80-4abc-444c-ae6e-f10c0bbb3f15'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:09 devstack cinder-volume[86046]: WARNING cinder.quota [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1953602951 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1953602951, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:27:09 devstack cinder-volume[86046]: WARNING cinder.quota [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1953602951 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1953602951, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Created reservations ['0426c646-b86a-4663-b70e-abfd009216b1', 'f7ff6b61-d97a-490e-ad0a-e3442f0e71a8', '3637380f-5260-401d-a41b-ff62d7fdf310', '8157e18d-a8af-4dad-b433-86d50aae8575'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:09 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" returned: 0 in 0.478s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:09 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 1G Sep 22 18:27:09 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:09 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:09 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:10 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-33395e53-8206-458a-8d57-6aea9fb4fa8c tempest-GroupsV314Test-792226545 None] Delete group completed successfully. Sep 22 18:27:10 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 1G" returned: 0 in 0.543s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:10 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 Sep 22 18:27:10 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-d5ad758d-d18f-4cb9-9347-8c3af651057c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "cinder-d5ad758d-d18f-4cb9-9347-8c3af651057c-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Acquiring lock "cinder-quobyte-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:10 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2" returned: 0 in 0.487s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:10 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 is being set with open permissions: ugo+rw Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a3190-6fe7-4001-a85b-7f2838fc0de6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:10 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 Sep 22 18:27:10 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-quobyte-d5ad758d-d18f-4cb9-9347-8c3af651057c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-d5ad758d-d18f-4cb9-9347-8c3af651057c" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e85c982-8b6f-4846-95e4-803b8c6318a5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:10 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:27:10 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c Sep 22 18:27:11 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info Sep 22 18:27:11 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.408s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640 Sep 22 18:27:11 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c" returned: 0 in 0.432s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c Sep 22 18:27:11 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info" returned: 0 in 0.307s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info is being set with open permissions: ugo+rw Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info Sep 22 18:27:11 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" returned: 0 in 0.281s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Lock "cinder-quobyte-ff6a1ff0-5116-4a38-98b0-68da9d6cd640" released by "delete_volume" :: held 0.825s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:11 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d5ad758d-d18f-4cb9-9347-8c3af651057c" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-d5ad758d-d18f-4cb9-9347-8c3af651057c" released by "delete_volume" :: held 0.781s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Created reservations ['49519ab8-2449-4ae9-8371-f28af17ef17e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:11 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.info" returned: 0 in 0.297s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Created reservations ['9c62c30f-90ee-4605-ac57-8c6a87b7728a', 'f982e334-f9f4-46e0-8d17-ba2e357ade5c', '3bc7542e-4bdb-470a-91e2-d2ce09d899d9', '4c1052ad-4fe0-4d40-b7ee-d3cd47af82f4'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Created reservations ['e216af86-9114-4336-9ce8-af20928e2ae4', 'afbbe170-f617-45b8-999b-db3b19f3343e', 'b24fe3ee-7b70-4bec-95e4-9b3d10f2e293', '945cd989-60f6-48af-af8b-4d2b4021a560'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e5fa3e13-defd-4601-9fd0-ec8bcde6d5d2 tempest-SnapshotMetadataTestJSON-1617629946 None] Create snapshot completed successfully Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:11 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:11 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:11 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:12 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.305s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Deleted volume successfully. Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6ef7bf8-57d7-47a9-9434-77f3f2be04ed tempest-VolumesListTestJSON-652977927 None] Lock "cinder-d5ad758d-d18f-4cb9-9347-8c3af651057c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:12 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.440s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fcd6fc98-3bb8-411e-8507-0f61ab3699ee tempest-GroupsV314Test-792226545 None] Delete group completed successfully. Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-f61247ad-1a85-4adb-9868-de648a17f72c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-f61247ad-1a85-4adb-9868-de648a17f72c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-quobyte-f61247ad-1a85-4adb-9868-de648a17f72c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-f61247ad-1a85-4adb-9868-de648a17f72c" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b746221-8c78-43cd-8b78-ef02fc768a5f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:13 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c Sep 22 18:27:13 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:13 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c" returned: 0 in 0.554s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "cinder-f7212fed-3e17-48a6-bfbf-70bdec67ecc2-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:13 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c Sep 22 18:27:13 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-f7212fed-3e17-48a6-bfbf-70bdec67ecc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "cinder-quobyte-f7212fed-3e17-48a6-bfbf-70bdec67ecc2" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-f7212fed-3e17-48a6-bfbf-70bdec67ecc2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Deleting offline snapshot f7212fed-3e17-48a6-bfbf-70bdec67ecc2 of volume 5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] snapshot_file for this snap is: volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3da269-8de5-4c6b-ba21-6b8619f19c63]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:13 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f61247ad-1a85-4adb-9868-de648a17f72c" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-f61247ad-1a85-4adb-9868-de648a17f72c" released by "delete_volume" :: held 0.968s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:14 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 Sep 22 18:27:14 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Created reservations ['5f603bb8-4203-434f-8d52-03f4fab361f4', '6b462e57-7f15-4d0b-b4a7-ad7d6639adc9', 'e0c34922-9cfb-4ced-8623-9bff14028f90', '695de48a-2a1d-4029-af89-ec12954df9e2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:14 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:14 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:14 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2" returned: 0 in 0.553s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6cc738-7eb9-4bd9-b3c1-7a27f2723c13]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:14 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.305s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Deleted volume successfully. Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a70cf442-72c0-44c5-9eaf-1a023972bce2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-f61247ad-1a85-4adb-9868-de648a17f72c-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:14 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc Sep 22 18:27:14 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:14 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" returned: 0 in 0.482s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:14 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 Sep 22 18:27:14 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-9c47a8f3-4a32-44da-b272-5a79586bafe4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-9c47a8f3-4a32-44da-b272-5a79586bafe4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "cinder-quobyte-9c47a8f3-4a32-44da-b272-5a79586bafe4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-9c47a8f3-4a32-44da-b272-5a79586bafe4" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:15 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2" returned: 0 in 0.552s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a03e5-b4f6-4161-b590-1b6dfa9e3eb5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:15 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2 Sep 22 18:27:15 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:15 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 Sep 22 18:27:15 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:15 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc.f7212fed-3e17-48a6-bfbf-70bdec67ecc2" returned: 0 in 0.425s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=173,cinder:SELECT=160,cinder:DELETE=12,cinder:INSERT=49 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-f7212fed-3e17-48a6-bfbf-70bdec67ecc2" released by "_delete_snapshot" :: held 2.190s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" released by "delete_snapshot" :: held 2.226s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Created reservations ['50d20e74-9088-475e-b302-5861da2f400a', '074fc70b-bd3d-42e1-8359-51bd086acbbe', '4b20f0c2-864c-423c-bb85-cbe8c28d4cd5', 'e14c542b-112c-45de-9b51-40cac95596d2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:16 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4" returned: 0 in 0.562s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:16 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4 Sep 22 18:27:16 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Delete snapshot completed successfully. Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-813a5e31-9814-485a-9e7e-706a477347ca tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-f7212fed-3e17-48a6-bfbf-70bdec67ecc2-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:16 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9c47a8f3-4a32-44da-b272-5a79586bafe4" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-quobyte-9c47a8f3-4a32-44da-b272-5a79586bafe4" released by "delete_volume" :: held 0.939s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Created reservations ['41fd1361-04cc-45fc-9ace-6db823145c92', '2cb64294-e9f0-4d33-a7bc-d6ffb8fc6f68', 'd35200fc-a1ba-489a-b3f5-46e8d809d460', '840ba65d-4a54-43d2-82bc-b2bf1ffd5212'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:16 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:16 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:16 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.326s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Deleted volume successfully. Sep 22 18:27:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1f0cddbd-7f62-4cb0-ab5c-8e9f0f828ac2 tempest-VolumesListTestJSON-652977927 None] Lock "cinder-9c47a8f3-4a32-44da-b272-5a79586bafe4-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "cinder-5b55beb4-660a-415e-9b8d-86b6cc7e53cc-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-5b55beb4-660a-415e-9b8d-86b6cc7e53cc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" acquired by "delete_volume" :: waited 0.039s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb31cc7-8e9e-4e28-9258-53365ffc60e3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:17 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc Sep 22 18:27:17 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:17 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:17 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc Sep 22 18:27:17 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:18 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-quobyte-5b55beb4-660a-415e-9b8d-86b6cc7e53cc" released by "delete_volume" :: held 0.887s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Created reservations ['eaca984b-1cd5-49f3-933e-ff82f0262d1b', 'c0e92090-025a-49f8-ab3b-a30f4f0b1c30', '8e8edc1a-dd1d-41cc-8e0a-7c91281cf962', '552914c6-32d0-432f-a9b0-98c5b785570d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:18 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:18 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:18 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.269s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Deleted volume successfully. Sep 22 18:27:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7351617b-6e76-4a10-99d0-2ae505d8e6b8 tempest-SnapshotMetadataTestJSON-1617629946 None] Lock "cinder-5b55beb4-660a-415e-9b8d-86b6cc7e53cc-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Flow 'volume_create_manager' (191dc9e9-a72c-4791-8dc7-6f96c6bb0ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b563e-8c1a-4a42-bcc5-d1a26292dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b563e-8c1a-4a42-bcc5-d1a26292dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-435182441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453e8dfc17b409597f2cc8b2d5746f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:21Z,use_quota=True,user_id='f95b2bad4f79436f8ca4be0847f27b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e16021-5c84-4b99-9b2f-8a78c984875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e16021-5c84-4b99-9b2f-8a78c984875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b648aa-32f0-4651-8908-8dce978a71d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b648aa-32f0-4651-8908-8dce978a71d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049', 'volume_name': 'volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba2698-4a88-40e1-a2c5-0f0103bc07f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcba2698-4a88-40e1-a2c5-0f0103bc07f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146a26f-5300-4f2f-986e-dd686c05e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:21 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume 0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049', 'volume_size': 1} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-435182441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453e8dfc17b409597f2cc8b2d5746f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:21Z,use_quota=True,user_id='f95b2bad4f79436f8ca4be0847f27b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Creating volume 0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:21 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:21 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 1073741824 Sep 22 18:27:21 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-857156ad-0f10-4b06-8ced-04932b6180e5 tempest-GroupsV320Test-1463857977 None] Group tempest-GroupsV320Test-Group-1130645007: creating Sep 22 18:27:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-857156ad-0f10-4b06-8ced-04932b6180e5 tempest-GroupsV320Test-1463857977 None] Group tempest-GroupsV320Test-Group-1130645007: created successfully Sep 22 18:27:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-857156ad-0f10-4b06-8ced-04932b6180e5 tempest-GroupsV320Test-1463857977 None] Create group completed successfully. Sep 22 18:27:21 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Flow 'volume_create_manager' (9bf65a58-0f3c-4d1a-a2a6-5a46d31d4d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279b37f1-c0d8-4c93-83dd-090b23b6c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279b37f1-c0d8-4c93-83dd-090b23b6c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452529265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9b282-b0b3-402c-a836-51d94e5823f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453e8dfc17b409597f2cc8b2d5746f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:22Z,use_quota=True,user_id='f95b2bad4f79436f8ca4be0847f27b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2b510f-2142-4137-be99-388b715f5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2b510f-2142-4137-be99-388b715f5827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908c4cfc-2593-4096-acca-86854a7779d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908c4cfc-2593-4096-acca-86854a7779d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb9b282-b0b3-402c-a836-51d94e5823f5', 'volume_name': 'volume-2fb9b282-b0b3-402c-a836-51d94e5823f5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ffbb78-847b-485b-baa6-e6ece4b8e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ffbb78-847b-485b-baa6-e6ece4b8e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9997e75d-024c-4fde-9f7b-3091ed3607bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume 2fb9b282-b0b3-402c-a836-51d94e5823f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb9b282-b0b3-402c-a836-51d94e5823f5', 'volume_size': 1} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 1073741824" returned: 0 in 0.643s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:22 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 Sep 22 18:27:22 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:22 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" returned: 0 in 0.327s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452529265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9b282-b0b3-402c-a836-51d94e5823f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453e8dfc17b409597f2cc8b2d5746f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:22Z,use_quota=True,user_id='f95b2bad4f79436f8ca4be0847f27b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Creating volume 2fb9b282-b0b3-402c-a836-51d94e5823f5 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:22 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146a26f-5300-4f2f-986e-dd686c05e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 1073741824 Sep 22 18:27:22 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da2043-2c72-47e2-b067-91327b879eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:22 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 (0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049): created successfully Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da2043-2c72-47e2-b067-91327b879eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Flow 'volume_create_manager' (191dc9e9-a72c-4791-8dc7-6f96c6bb0ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-072903fa-4a17-4950-ae4a-db67d972e10e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Created volume successfully. Sep 22 18:27:23 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 1073741824" returned: 0 in 0.838s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:23 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 Sep 22 18:27:23 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Created reservations ['0dbd6f38-309c-4bc5-aa16-36e2800ac0f5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:23 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:23 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:23 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5" returned: 0 in 0.421s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9997e75d-024c-4fde-9f7b-3091ed3607bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb9b282-b0b3-402c-a836-51d94e5823f5', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6d5115-0262-42f3-b9b3-5e547fefc0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Volume volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 (2fb9b282-b0b3-402c-a836-51d94e5823f5): created successfully Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6d5115-0262-42f3-b9b3-5e547fefc0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Flow 'volume_create_manager' (9bf65a58-0f3c-4d1a-a2a6-5a46d31d4d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5c592451-efc2-4637-a4cc-76d61de9ac2e tempest-TestServerVolumeAttachmentScenario-1300468898 None] Created volume successfully. Sep 22 18:27:24 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.555s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:24 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a13685fb-8a7b-4e8a-b9fa-61f5c8da3de7 tempest-GroupsV320Test-1463857977 None] Delete group completed successfully. Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Flow 'volume_create_manager' (4a927f9d-05e5-4bb1-a18a-c0cc88731006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755a4a15-3293-4fa1-913f-ef6adc1e015c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755a4a15-3293-4fa1-913f-ef6adc1e015c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2054687737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f514a17a-b457-48ea-9bc6-1a805561f597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a62f706a34c99b9b4c8e522a054a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:25Z,use_quota=True,user_id='ec5ae2ea376a4ffa8682ded2992d5e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17bdc24-01f8-4083-ab7e-998220a5a5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17bdc24-01f8-4083-ab7e-998220a5a5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee34156-8b7d-455c-9888-bf3fb121ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee34156-8b7d-455c-9888-bf3fb121ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f514a17a-b457-48ea-9bc6-1a805561f597', 'volume_name': 'volume-f514a17a-b457-48ea-9bc6-1a805561f597', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36820ad3-aced-4e1b-adf6-2739ab43d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36820ad3-aced-4e1b-adf6-2739ab43d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e031df6-5142-4579-a1b4-eca3138c6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Volume f514a17a-b457-48ea-9bc6-1a805561f597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f514a17a-b457-48ea-9bc6-1a805561f597', 'volume_size': 1} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2054687737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f514a17a-b457-48ea-9bc6-1a805561f597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a62f706a34c99b9b4c8e522a054a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:25Z,use_quota=True,user_id='ec5ae2ea376a4ffa8682ded2992d5e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Creating volume f514a17a-b457-48ea-9bc6-1a805561f597 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:25 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:25 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 1073741824 Sep 22 18:27:25 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:26 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 1073741824" returned: 0 in 0.572s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:26 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 Sep 22 18:27:26 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:26 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597" returned: 0 in 0.311s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e031df6-5142-4579-a1b4-eca3138c6482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f514a17a-b457-48ea-9bc6-1a805561f597', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e66fa-1d7b-4524-9f14-ac1bfdce695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Volume volume-f514a17a-b457-48ea-9bc6-1a805561f597 (f514a17a-b457-48ea-9bc6-1a805561f597): created successfully Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e66fa-1d7b-4524-9f14-ac1bfdce695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Flow 'volume_create_manager' (4a927f9d-05e5-4bb1-a18a-c0cc88731006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-84b6a023-0c9f-4fdc-bce4-b45b2f73b316 tempest-AbsoluteLimitsTests-2065748219 None] Created volume successfully. Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Acquiring lock "cinder-f514a17a-b457-48ea-9bc6-1a805561f597-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "cinder-f514a17a-b457-48ea-9bc6-1a805561f597-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Acquiring lock "cinder-quobyte-f514a17a-b457-48ea-9bc6-1a805561f597" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "cinder-quobyte-f514a17a-b457-48ea-9bc6-1a805561f597" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2d66e-7155-4374-b38b-239c0fe6c6f3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:28 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 Sep 22 18:27:28 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:28 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597" returned: 0 in 0.506s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:28 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597 Sep 22 18:27:28 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:29 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f514a17a-b457-48ea-9bc6-1a805561f597" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "cinder-quobyte-f514a17a-b457-48ea-9bc6-1a805561f597" released by "delete_volume" :: held 1.000s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Created reservations ['f6848c3e-a192-41cc-9c40-01a3772dd7aa', 'b2f8e200-7082-4e88-ab0d-d4f69d6992b4', 'b85c8e49-ceee-4bf1-97d8-1f7adbadcebc', '44a0d5fc-3b48-4949-96b2-290fa6892bd3'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:29 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:29 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:29 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.327s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:29 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Deleted volume successfully. Sep 22 18:27:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ae5c892d-add8-4d30-ad78-d73db86c7a15 tempest-AbsoluteLimitsTests-2065748219 None] Lock "cinder-f514a17a-b457-48ea-9bc6-1a805561f597-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:27:39 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:INSERT=31,cinder:SELECT=115,cinder:UPDATE=144,cinder:DELETE=10 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:27:40 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=27,cinder:INSERT=14,cinder:UPDATE=40,cinder:DELETE=5 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:48 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:27:48 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Flow 'volume_create_manager' (eb29d24b-5de1-458f-8ce5-e546047a567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f0f7db-baab-4ebd-bf90-3b7aacf15078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f0f7db-baab-4ebd-bf90-3b7aacf15078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1989293114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ff6bae-49a1-450e-8297-30eddb7a1321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a893ace244d6492f843ebd261fa123ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:48Z,use_quota=True,user_id='980133c3f0f748d780ac236e1a3bffbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d657f-074e-4e47-b5d2-1c1c9f80d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d657f-074e-4e47-b5d2-1c1c9f80d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a602964-d4a4-4335-9c90-2e82553ced25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a602964-d4a4-4335-9c90-2e82553ced25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ff6bae-49a1-450e-8297-30eddb7a1321', 'volume_name': 'volume-a2ff6bae-49a1-450e-8297-30eddb7a1321', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7878f675-a3e2-4c9b-86dc-ee008e09e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7878f675-a3e2-4c9b-86dc-ee008e09e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768d32e-25d9-4fab-9dbd-842703336c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Volume a2ff6bae-49a1-450e-8297-30eddb7a1321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ff6bae-49a1-450e-8297-30eddb7a1321', 'volume_size': 1} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1989293114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ff6bae-49a1-450e-8297-30eddb7a1321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a893ace244d6492f843ebd261fa123ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:48Z,use_quota=True,user_id='980133c3f0f748d780ac236e1a3bffbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Creating volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:48 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:48 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 1073741824 Sep 22 18:27:48 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:48 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.404s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:27:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:27:49 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 1073741824" returned: 0 in 0.908s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:49 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 Sep 22 18:27:49 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:50 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768d32e-25d9-4fab-9dbd-842703336c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ff6bae-49a1-450e-8297-30eddb7a1321', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c782fab-8d11-4a00-b7b5-b8ddaf065297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Volume volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 (a2ff6bae-49a1-450e-8297-30eddb7a1321): created successfully Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c782fab-8d11-4a00-b7b5-b8ddaf065297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Flow 'volume_create_manager' (eb29d24b-5de1-458f-8ce5-e546047a567e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3bbda377-669f-408b-9b16-b217e036aaa3 tempest-SnapshotsActionsTest-729094195 None] Created volume successfully. Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Creating offline snapshot 8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:27:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0592c2-2cf1-4083-87b5-1dd79ca42056]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:51 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 Sep 22 18:27:51 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:51 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321" returned: 0 in 0.381s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:51 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d 1G Sep 22 18:27:51 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:51 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d 1G" returned: 0 in 0.485s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:51 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:27:51 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:52 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:52 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d is being set with open permissions: ugo+rw Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:52 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:27:52 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:52 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.320s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:52 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info Sep 22 18:27:52 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:52 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info" returned: 0 in 0.296s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:52 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info is being set with open permissions: ugo+rw Sep 22 18:27:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:52 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info Sep 22 18:27:52 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:53 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.info" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:53 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-35687cd4-b3ca-45f5-963f-17d4a68d9854 tempest-SnapshotsActionsTest-729094195 None] Create snapshot completed successfully Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Creating offline snapshot 2a2df851-f44b-40e8-9212-1598c162cea0 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[656c315e-7cce-417c-9609-cb6e347897d3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:55 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:27:55 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:55 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.635s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:27:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:55 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 1G Sep 22 18:27:55 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:56 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Flow 'volume_create_manager' (b3d63184-a2d6-4353-bfb3-532d0d874e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817b1bd-35e5-4ad1-be81-62ab4b0c1341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 1G" returned: 0 in 0.971s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817b1bd-35e5-4ad1-be81-62ab4b0c1341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176862289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e116f42-0183-4017-855b-05c8fc859c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27bef6832f84e41b37a2c2659569306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:57Z,use_quota=True,user_id='ce49cf3711f743a4aac5b5e31aa62b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa0ebb4-3b0f-46dc-b7c8-d6d000db162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa0ebb4-3b0f-46dc-b7c8-d6d000db162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:56 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b807a2-9b06-4943-a9d5-3d0c89e28904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b807a2-9b06-4943-a9d5-3d0c89e28904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e116f42-0183-4017-855b-05c8fc859c71', 'volume_name': 'volume-9e116f42-0183-4017-855b-05c8fc859c71', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:56 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5f2199-06fd-4d42-8d82-f2ef89bfa523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5f2199-06fd-4d42-8d82-f2ef89bfa523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7d50c1-c7d0-4d19-a646-a22aa77ba770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Volume 9e116f42-0183-4017-855b-05c8fc859c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e116f42-0183-4017-855b-05c8fc859c71', 'volume_size': 1} Sep 22 18:27:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:57 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:57 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 is being set with open permissions: ugo+rw Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:57 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 Sep 22 18:27:57 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:57 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.586s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176862289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e116f42-0183-4017-855b-05c8fc859c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27bef6832f84e41b37a2c2659569306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:57Z,use_quota=True,user_id='ce49cf3711f743a4aac5b5e31aa62b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Creating volume 9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:57 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 1073741824 Sep 22 18:27:57 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c34def9c-5892-4092-809f-29a30e25ab3b tempest-SnapshotsActionsTest-729094195 None] Create snapshot completed successfully Sep 22 18:27:58 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 1073741824" returned: 0 in 0.511s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (777de74e-67ba-450d-a68e-20d7f93186b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab494fe-0b27-4098-b3ce-e93a7643ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab494fe-0b27-4098-b3ce-e93a7643ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-184041008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843c7e24-f35a-4242-85a1-3193ac010407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:58Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49c8abfb-f62d-4b56-b651-17c0dbb88f14),volume_type_id=49c8abfb-f62d-4b56-b651-17c0dbb88f14)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37576e09-4c67-44d5-8cf7-4fecc19152da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37576e09-4c67-44d5-8cf7-4fecc19152da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a450c1-0ff5-4ed3-9be3-c6eb769e9b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a450c1-0ff5-4ed3-9be3-c6eb769e9b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843c7e24-f35a-4242-85a1-3193ac010407', 'volume_name': 'volume-843c7e24-f35a-4242-85a1-3193ac010407', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8dcf7b-cec3-451f-aa13-38be474b2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8dcf7b-cec3-451f-aa13-38be474b2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f4bfbf-d898-478d-817a-559542d57158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume 843c7e24-f35a-4242-85a1-3193ac010407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843c7e24-f35a-4242-85a1-3193ac010407', 'volume_size': 1} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:58 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:27:58 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-2a2df851-f44b-40e8-9212-1598c162cea0-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-2a2df851-f44b-40e8-9212-1598c162cea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-2a2df851-f44b-40e8-9212-1598c162cea0" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-2a2df851-f44b-40e8-9212-1598c162cea0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Deleting offline snapshot 2a2df851-f44b-40e8-9212-1598c162cea0 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] snapshot_file for this snap is: volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba407f-7374-4957-b704-64fd4c5c54e2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:58 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (6500e247-bb99-41a2-831a-f065e54bd387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a703a8be-d977-4dcb-85ed-6d98891d5d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.421s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-184041008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843c7e24-f35a-4242-85a1-3193ac010407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:58Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49c8abfb-f62d-4b56-b651-17c0dbb88f14),volume_type_id=49c8abfb-f62d-4b56-b651-17c0dbb88f14)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Creating volume 843c7e24-f35a-4242-85a1-3193ac010407 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:58 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a703a8be-d977-4dcb-85ed-6d98891d5d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1083973713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ff07de-d0de-47df-8c8d-94fab426a9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:59Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc57992-6bb4-48c0-9976-4cf7c746abdf),volume_type_id=ebc57992-6bb4-48c0-9976-4cf7c746abdf)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fae1e4-e786-4712-802d-cb603c1ad6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fae1e4-e786-4712-802d-cb603c1ad6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1778aa07-517e-4b1e-b782-cd6514b969e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 1073741824 Sep 22 18:27:58 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 Sep 22 18:27:58 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:58 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1778aa07-517e-4b1e-b782-cd6514b969e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ff07de-d0de-47df-8c8d-94fab426a9f1', 'volume_name': 'volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a76177-6dc0-4368-99b6-c6c2d4f16284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a76177-6dc0-4368-99b6-c6c2d4f16284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1560de-9a78-49c6-9a81-3d49546d95c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume f5ff07de-d0de-47df-8c8d-94fab426a9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1', 'volume_size': 1} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7d50c1-c7d0-4d19-a646-a22aa77ba770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e116f42-0183-4017-855b-05c8fc859c71', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac7036-47ac-4057-8c5d-50cf33997524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Volume volume-9e116f42-0183-4017-855b-05c8fc859c71 (9e116f42-0183-4017-855b-05c8fc859c71): created successfully Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac7036-47ac-4057-8c5d-50cf33997524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Flow 'volume_create_manager' (b3d63184-a2d6-4353-bfb3-532d0d874e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1011b164-a9e3-4943-93da-475ff570457e tempest-VolumesActionsTest-61151143 None] Created volume successfully. Sep 22 18:27:59 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0" returned: 0 in 0.686s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a30e2-3be3-4687-ab55-6663a053bf62]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:27:59 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (5dbf781b-2c4b-47b3-9b7e-0fdd6db4ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:27:59 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:27:59 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8c2e8e-ec20-4667-9c2a-0fe5a678adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 1073741824" returned: 0 in 0.725s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8c2e8e-ec20-4667-9c2a-0fe5a678adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-424459174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56ac3e-3706-4ef8-b570-1c98ff86d2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:59Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da410d86-2463-44fc-b0c9-28a21dc953e3),volume_type_id=da410d86-2463-44fc-b0c9-28a21dc953e3)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be2dc2e-e363-431a-99c8-b3ca55537564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be2dc2e-e363-431a-99c8-b3ca55537564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a693e83-4336-42a2-a61e-5aaf0672a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:59 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 Sep 22 18:27:59 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:59 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.471s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:59 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 Sep 22 18:27:59 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:59 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407" returned: 0 in 0.324s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1083973713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ff07de-d0de-47df-8c8d-94fab426a9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:59Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebc57992-6bb4-48c0-9976-4cf7c746abdf),volume_type_id=ebc57992-6bb4-48c0-9976-4cf7c746abdf)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Creating volume f5ff07de-d0de-47df-8c8d-94fab426a9f1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:27:59 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f4bfbf-d898-478d-817a-559542d57158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843c7e24-f35a-4242-85a1-3193ac010407', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:59 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 1073741824 Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e41c47-b2d6-4203-a11d-4b3d523d1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:27:59 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:27:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume volume-843c7e24-f35a-4242-85a1-3193ac010407 (843c7e24-f35a-4242-85a1-3193ac010407): created successfully Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e41c47-b2d6-4203-a11d-4b3d523d1863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:27:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (777de74e-67ba-450d-a68e-20d7f93186b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:28:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2ffe1a33-14c9-464b-bfd9-64c5490c3f73 tempest-TestInstancesWithCinderVolumes-621238226 None] Created volume successfully. Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a693e83-4336-42a2-a61e-5aaf0672a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f56ac3e-3706-4ef8-b570-1c98ff86d2d6', 'volume_name': 'volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6', 'volume_size': 1, 'image_id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1942284643', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'baa738b7bee4493abbc352b312373ea1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'created_at': datetime.datetime(2026, 9, 22, 16, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc52d436-381b-4618-a5f3-9f5c26429e8b/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90dfc15-7463-4db7-8324-decf98e7e204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90dfc15-7463-4db7-8324-decf98e7e204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97054160-3b50-4bb8-b0b3-37da7a8bcf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:00 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6', 'volume_size': 1, 'image_id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1942284643', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'baa738b7bee4493abbc352b312373ea1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'created_at': datetime.datetime(2026, 9, 22, 16, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc52d436-381b-4618-a5f3-9f5c26429e8b/file', 'properties': {}}, 'image_service': } Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Trying to clone 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 from image fc52d436-381b-4618-a5f3-9f5c26429e8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:28:00 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0" returned: 0 in 0.717s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:00 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0 Sep 22 18:28:00 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:00 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 1073741824" returned: 0 in 0.663s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-90167928-61e7-45ca-886b-ecadd7ae3538 req-8617833c-3b87-4ae4-ba9b-365545617a9b tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:00 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 Sep 22 18:28:00 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:00 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.2a2df851-f44b-40e8-9212-1598c162cea0" returned: 0 in 0.321s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-2a2df851-f44b-40e8-9212-1598c162cea0" released by "_delete_snapshot" :: held 2.324s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_snapshot" :: held 2.359s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:00 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Created reservations ['27654e7b-8f8a-4b20-9d41-ca08c2c4def2', 'ebe7c257-5ebe-4d70-a6eb-bb1a0bf0268b', '8d426c0a-22d6-48c2-ac0b-0ac7df7b6a2a', 'aedb4000-3724-4ed5-b03f-2a3719e5625c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-90167928-61e7-45ca-886b-ecadd7ae3538 req-8617833c-3b87-4ae4-ba9b-365545617a9b tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.341s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1560de-9a78-49c6-9a81-3d49546d95c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8bb18-4679-4b3d-a536-78df686cfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-90167928-61e7-45ca-886b-ecadd7ae3538 req-8617833c-3b87-4ae4-ba9b-365545617a9b tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Volume volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 (f5ff07de-d0de-47df-8c8d-94fab426a9f1): created successfully Sep 22 18:28:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8bb18-4679-4b3d-a536-78df686cfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (6500e247-bb99-41a2-831a-f065e54bd387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:28:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-98337063-9ecf-4dca-9b16-6b6b2847ea26 tempest-TestInstancesWithCinderVolumes-621238226 None] Created volume successfully. Sep 22 18:28:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-90167928-61e7-45ca-886b-ecadd7ae3538 req-8617833c-3b87-4ae4-ba9b-365545617a9b tempest-TestServerVolumeAttachmentScenario-1300468898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db339f00-5d80-4c76-a24c-ea78ee344574', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:28:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Delete snapshot completed successfully. Sep 22 18:28:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-edc3fa1a-c2dd-4b22-b413-52c79f7ad874 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-2a2df851-f44b-40e8-9212-1598c162cea0-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-90167928-61e7-45ca-886b-ecadd7ae3538 req-8617833c-3b87-4ae4-ba9b-365545617a9b tempest-TestServerVolumeAttachmentScenario-1300468898 None] attachment_update completed successfully. Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Creating offline snapshot da23eb41-6be9-4a1f-ac6d-6c99468ab788 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[137942c6-86bb-4c4c-aa70-3f1d200dff49]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:02 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:02 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:02 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.509s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:02 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 1G Sep 22 18:28:02 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:03 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 1G" returned: 0 in 0.682s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:03 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 Sep 22 18:28:03 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:03 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788" returned: 0 in 0.444s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:03 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 is being set with open permissions: ugo+rw Sep 22 18:28:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:04 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 Sep 22 18:28:04 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:04 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788" returned: 0 in 0.333s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-be4b4cff-6ebf-458b-9054-dd16e52fe0ec tempest-SnapshotsActionsTest-729094195 None] Create snapshot completed successfully Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD, size 20.69 MB, duration 5.21 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:28:05 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Image download 20.69 MB at 3.97 MB/s Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[50060fcc-e8ec-486d-b4aa-4f2cf53231bf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:05 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD Sep 22 18:28:05 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-da23eb41-6be9-4a1f-ac6d-6c99468ab788-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-da23eb41-6be9-4a1f-ac6d-6c99468ab788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-da23eb41-6be9-4a1f-ac6d-6c99468ab788" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-da23eb41-6be9-4a1f-ac6d-6c99468ab788" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Deleting offline snapshot da23eb41-6be9-4a1f-ac6d-6c99468ab788 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:28:05 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] snapshot_file for this snap is: volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Temporary image fc52d436-381b-4618-a5f3-9f5c26429e8b is fetched for user ae96e0b4375247c7b730a20ca6462945. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[93862e7e-f9bb-4f16-9aab-c286d74a7816]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7fa4de-ce2c-4e84-a966-754d6cb1e150]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:06 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 Sep 22 18:28:06 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3ea64ce1-179b-4598-a32c-333941e007b2 req-f90ded56-cd22-4889-9cfd-c19fd090c831 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3ea64ce1-179b-4598-a32c-333941e007b2 req-f90ded56-cd22-4889-9cfd-c19fd090c831 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3ea64ce1-179b-4598-a32c-333941e007b2 req-f90ded56-cd22-4889-9cfd-c19fd090c831 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:06 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD Sep 22 18:28:06 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-3ea64ce1-179b-4598-a32c-333941e007b2 req-f90ded56-cd22-4889-9cfd-c19fd090c831 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-2fb9b282-b0b3-402c-a836-51d94e5823f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f259618b-e9f1-4f9f-8075-7a21ce9b845e', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:28:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-3ea64ce1-179b-4598-a32c-333941e007b2 req-f90ded56-cd22-4889-9cfd-c19fd090c831 tempest-TestServerVolumeAttachmentScenario-1300468898 None] attachment_update completed successfully. Sep 22 18:28:06 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:06 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788" returned: 0 in 0.778s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-424459174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56ac3e-3706-4ef8-b570-1c98ff86d2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa738b7bee4493abbc352b312373ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:27:59Z,use_quota=True,user_id='ae96e0b4375247c7b730a20ca6462945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da410d86-2463-44fc-b0c9-28a21dc953e3),volume_type_id=da410d86-2463-44fc-b0c9-28a21dc953e3)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Creating volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:28:06 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af4a69-8fdc-477b-9e76-7136b52e711e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:06 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1073741824 Sep 22 18:28:06 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:07 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:07 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:07 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.886s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:07 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 Sep 22 18:28:07 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:07 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1073741824" returned: 0 in 0.992s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:07 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 Sep 22 18:28:07 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:08 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" returned: 0 in 0.497s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Attempting download of fc52d436-381b-4618-a5f3-9f5c26429e8b ((None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}])) to volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b42f6-b822-4957-bbf5-f0019c9e21d0]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:08 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788" returned: 0 in 0.894s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:08 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788 Sep 22 18:28:08 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:08 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u Sep 22 18:28:08 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:08 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.da23eb41-6be9-4a1f-ac6d-6c99468ab788" returned: 0 in 0.435s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-da23eb41-6be9-4a1f-ac6d-6c99468ab788" released by "_delete_snapshot" :: held 3.252s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_snapshot" :: held 3.295s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:09 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Created reservations ['cefd88de-ec37-4463-a9b4-df993b9149fd', '9d830f40-8ada-4e52-a8e1-d58d6d153aab', '71e89bb9-5e53-4098-9ba8-474c620f24c8', '44c9f9be-3bf6-455a-8bcc-f2c62e8efc0b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u" returned: 0 in 0.628s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Delete snapshot completed successfully. Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5e845f61-f332-4797-9a25-daba206f895a tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-da23eb41-6be9-4a1f-ac6d-6c99468ab788-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:09 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u Sep 22 18:28:09 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-253d9c0d-a423-486d-94a6-9d682a8d29bc req-d971ce99-11f4-41ba-b8d7-d64e6fceb5b3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Terminate volume connection completed successfully. Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-253d9c0d-a423-486d-94a6-9d682a8d29bc req-d971ce99-11f4-41ba-b8d7-d64e6fceb5b3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Deleting attachment f259618b-e9f1-4f9f-8075-7a21ce9b845e. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:28:09 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u" returned: 1 in 0.415s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc52d436-381b-4618-a5f3-9f5c26429e8b_bjh3v_2u' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da1a3a-6236-4077-b6a5-e8422b96eb0e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:09 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD Sep 22 18:28:09 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e66f73b8-cfa2-436f-b4d3-9193b395b072 tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" by "attach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e66f73b8-cfa2-436f-b4d3-9193b395b072 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" acquired by "attach_volume" :: waited 0.054s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:10 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] fc52d436-381b-4618-a5f3-9f5c26429e8b was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:10 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 Sep 22 18:28:10 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e66f73b8-cfa2-436f-b4d3-9193b395b072 tempest-VolumesActionsTest-61151143 None] Attaching volume 9e116f42-0183-4017-855b-05c8fc859c71 to instance 53336eed-11d5-4823-85b7-3f7dc9374d41 at mountpoint /dev/vdb on host None. Sep 22 18:28:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e66f73b8-cfa2-436f-b4d3-9193b395b072 tempest-VolumesActionsTest-61151143 None] Attach volume completed successfully. Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e66f73b8-cfa2-436f-b4d3-9193b395b072 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" released by "attach_volume" :: held 0.278s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-60c89f10-6a1f-4c4a-835e-38b6112cf6d6 tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" by "detach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-60c89f10-6a1f-4c4a-835e-38b6112cf6d6 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-60c89f10-6a1f-4c4a-835e-38b6112cf6d6 tempest-VolumesActionsTest-61151143 None] Detaching volume 9e116f42-0183-4017-855b-05c8fc859c71 from instance 53336eed-11d5-4823-85b7-3f7dc9374d41. Sep 22 18:28:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-60c89f10-6a1f-4c4a-835e-38b6112cf6d6 tempest-VolumesActionsTest-61151143 None] Detach volume completed successfully. Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-60c89f10-6a1f-4c4a-835e-38b6112cf6d6 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Creating offline snapshot 08ba097b-299f-45bf-b57b-c436b6ebdd48 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e17360-6d5e-4a00-9685-86b6d7d920bb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:11 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:11 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:11 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.825s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:11 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 1G Sep 22 18:28:11 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-e13ba800-4d66-40c3-aca1-e76041affe2d req-85bd7634-53f5-45d3-91a8-1b389650b8a7 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Terminate volume connection completed successfully. Sep 22 18:28:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-e13ba800-4d66-40c3-aca1-e76041affe2d req-85bd7634-53f5-45d3-91a8-1b389650b8a7 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Deleting attachment db339f00-5d80-4c76-a24c-ea78ee344574. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:28:12 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 1G" returned: 0 in 0.772s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:12 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 Sep 22 18:28:12 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:13 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48" returned: 0 in 0.495s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:13 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 is being set with open permissions: ugo+rw Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:13 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 Sep 22 18:28:13 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:13 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" returned: 0 in 3.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc52d436-381b-4618-a5f3-9f5c26429e8b_52oxbls9devstack@QuobyteHD, size 112.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:28:13 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Converted 112.00 MB image at 33.53 MB/s Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:13 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1G Sep 22 18:28:13 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:13 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48" returned: 0 in 0.529s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.833s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-12a551ec-9fe2-406a-9c11-12b742464eef tempest-SnapshotsActionsTest-729094195 None] Create snapshot completed successfully Sep 22 18:28:13 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 1G" returned: 0 in 0.523s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Downloaded image fc52d436-381b-4618-a5f3-9f5c26429e8b ((None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}])) to volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Temporary image fc52d436-381b-4618-a5f3-9f5c26429e8b for user ae96e0b4375247c7b730a20ca6462945 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Marking volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Copying metadata from image fc52d436-381b-4618-a5f3-9f5c26429e8b to 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:28:13 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Creating volume glance metadata for volume 6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 backed by image fc52d436-381b-4618-a5f3-9f5c26429e8b with: {'image_id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'image_name': 'tempest-scenario-img--1942284643', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97054160-3b50-4bb8-b0b3-37da7a8bcf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6', 'volume_size': 1, 'image_id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc52d436-381b-4618-a5f3-9f5c26429e8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1942284643', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'baa738b7bee4493abbc352b312373ea1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc52d436-381b-4618-a5f3-9f5c26429e8b', 'created_at': datetime.datetime(2026, 9, 22, 16, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc52d436-381b-4618-a5f3-9f5c26429e8b/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d38b0b3-17af-4eab-813f-c20f6219edc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:14 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Volume volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 (6f56ac3e-3706-4ef8-b570-1c98ff86d2d6): created successfully Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d38b0b3-17af-4eab-813f-c20f6219edc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Flow 'volume_create_manager' (5dbf781b-2c4b-47b3-9b7e-0fdd6db4ad09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:28:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-54114d98-7cc3-4fd1-8283-25b5adcd753b tempest-TestInstancesWithCinderVolumes-621238226 None] Created volume successfully. Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-08ba097b-299f-45bf-b57b-c436b6ebdd48-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-08ba097b-299f-45bf-b57b-c436b6ebdd48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-08ba097b-299f-45bf-b57b-c436b6ebdd48" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-08ba097b-299f-45bf-b57b-c436b6ebdd48" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Deleting offline snapshot 08ba097b-299f-45bf-b57b-c436b6ebdd48 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] snapshot_file for this snap is: volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3cbfc-696d-4e3d-9191-3196616ee164]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:14 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 Sep 22 18:28:14 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:15 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48" returned: 0 in 0.474s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc7c950-cf9e-4294-b91c-afe1d53643f6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:15 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:15 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:15 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.637s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:15 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 Sep 22 18:28:15 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:16 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48" returned: 0 in 0.719s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:16 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48 Sep 22 18:28:16 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:16 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.08ba097b-299f-45bf-b57b-c436b6ebdd48" returned: 0 in 0.342s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-08ba097b-299f-45bf-b57b-c436b6ebdd48" released by "_delete_snapshot" :: held 2.328s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_snapshot" :: held 2.365s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:16 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Created reservations ['a80a0458-3b72-4ee0-b8ab-e1675c22eafd', '8d7fa2e3-ebaa-4265-80b0-31ed3a3ea1c2', '3d2ce31f-72af-4d2b-87aa-558593a2e377', '17d73e70-54cd-4d2f-b052-d17684b30c8b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Delete snapshot completed successfully. Sep 22 18:28:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cfc9a0e2-8c66-428a-a59f-8be5c986e4d7 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-08ba097b-299f-45bf-b57b-c436b6ebdd48-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Creating offline snapshot 1eb7cff3-0197-4773-bc4e-502eaa3c3b46 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:28:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2c3a4c-9500-40d3-924d-583d5f0b9131]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:18 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:18 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "cinder-2fb9b282-b0b3-402c-a836-51d94e5823f5-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-2fb9b282-b0b3-402c-a836-51d94e5823f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "cinder-quobyte-2fb9b282-b0b3-402c-a836-51d94e5823f5" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-quobyte-2fb9b282-b0b3-402c-a836-51d94e5823f5" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2ce41-6813-4aaf-8fab-a1507b2b798a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:19 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.588s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:19 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 1G Sep 22 18:28:19 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:19 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 Sep 22 18:28:19 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8fc71184-968b-4c15-b286-7f4e3bd0aa6c req-63bd9a32-45cf-4085-91c2-ffbb55d193e2 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:19 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5" returned: 0 in 0.601s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:19 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5 Sep 22 18:28:19 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:19 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 1G" returned: 0 in 0.614s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:19 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 Sep 22 18:28:19 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:20 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2fb9b282-b0b3-402c-a836-51d94e5823f5" returned: 0 in 0.318s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-quobyte-2fb9b282-b0b3-402c-a836-51d94e5823f5" released by "delete_volume" :: held 0.988s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Created reservations ['f867d1e2-a1f5-4d52-881b-0e27746a3db2', '5aab4f3a-7ba5-446d-9ed2-4f62871d55a1', '2264f2b7-df20-43b7-8456-77fc1656f8b5', '160c7984-d6ec-43d8-973f-eb4b372260c6'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:20 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46" returned: 0 in 0.482s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:20 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 is being set with open permissions: ugo+rw Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:20 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:28:20 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:20 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 Sep 22 18:28:20 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:20 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:20 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.382s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:28:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Deleted volume successfully. Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8fc71184-968b-4c15-b286-7f4e3bd0aa6c req-63bd9a32-45cf-4085-91c2-ffbb55d193e2 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.064s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-8fc71184-968b-4c15-b286-7f4e3bd0aa6c req-63bd9a32-45cf-4085-91c2-ffbb55d193e2 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d542e1-9bcb-43e4-89ea-e3c56dc1fb33 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-2fb9b282-b0b3-402c-a836-51d94e5823f5-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-93d630a2-b240-457e-bc09-d750cc50d685 tempest-SnapshotsActionsTest-729094195 None] Create snapshot completed successfully Sep 22 18:28:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-8fc71184-968b-4c15-b286-7f4e3bd0aa6c req-63bd9a32-45cf-4085-91c2-ffbb55d193e2 tempest-TestInstancesWithCinderVolumes-621238226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '809335ea-ffe1-415a-b8d3-8445529261ca', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:28:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8fc71184-968b-4c15-b286-7f4e3bd0aa6c req-63bd9a32-45cf-4085-91c2-ffbb55d193e2 tempest-TestInstancesWithCinderVolumes-621238226 None] attachment_update completed successfully. Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "cinder-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "cinder-quobyte-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-quobyte-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04be2a9-9b7a-4483-82f8-c77be6c1cd4b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:21 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 Sep 22 18:28:21 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-1eb7cff3-0197-4773-bc4e-502eaa3c3b46-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-1eb7cff3-0197-4773-bc4e-502eaa3c3b46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Acquiring lock "cinder-quobyte-1eb7cff3-0197-4773-bc4e-502eaa3c3b46" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-1eb7cff3-0197-4773-bc4e-502eaa3c3b46" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Deleting offline snapshot 1eb7cff3-0197-4773-bc4e-502eaa3c3b46 of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] snapshot_file for this snap is: volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa8582a-ccd2-4b71-9908-fb9374e7d359]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:22 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" returned: 0 in 0.839s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:22 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 Sep 22 18:28:22 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:22 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049 Sep 22 18:28:22 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:22 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" returned: 0 in 0.468s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-quobyte-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049" released by "delete_volume" :: held 1.389s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:22 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46" returned: 0 in 0.757s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da153f8-5092-42b8-bcf9-f3fae101520f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Created reservations ['0eb1f4ae-6d03-442f-bb87-c24bd6791843', '6ec0e975-e8a6-4c49-a799-0edf9d619363', 'a0af1686-bcad-4947-bf58-2a731885bbb5', 'b5f8ab3f-f526-4e0a-89ae-493f2c6fdaa5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:23 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:23 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:23 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:28:23 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:23 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.702s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:23 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 Sep 22 18:28:23 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:23 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:28:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Deleted volume successfully. Sep 22 18:28:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6eca2b0-1efc-4cce-89a6-3c5c8071bfe3 tempest-TestServerVolumeAttachmentScenario-1300468898 None] Lock "cinder-0a6f5a5e-3b9b-4aac-b2ca-1ccf77d58049-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:24 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46" returned: 0 in 1.233s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:25 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46 Sep 22 18:28:25 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:25 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.1eb7cff3-0197-4773-bc4e-502eaa3c3b46" returned: 0 in 0.677s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-1eb7cff3-0197-4773-bc4e-502eaa3c3b46" released by "_delete_snapshot" :: held 3.633s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_snapshot" :: held 3.714s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:26 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Created reservations ['5a878930-b00e-4c42-90d1-75178a5ee83d', 'a465024e-7592-4bdd-9c91-80db31f71dbe', '022e0547-faa2-4d08-83b1-d9af453c5618', '3c1f9f92-516b-4824-8074-eaee777e7a61'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Delete snapshot completed successfully. Sep 22 18:28:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-31a15276-4f86-4279-92d2-4860a4a63048 tempest-SnapshotsActionsTest-1730132202 None] Lock "cinder-1eb7cff3-0197-4773-bc4e-502eaa3c3b46-delete_snapshot" released by "delete_snapshot" :: held 4.262s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5eb45e5c-4c58-4b6e-8036-895baf74c844 tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" by "attach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5eb45e5c-4c58-4b6e-8036-895baf74c844 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" acquired by "attach_volume" :: waited 0.039s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5eb45e5c-4c58-4b6e-8036-895baf74c844 tempest-VolumesActionsTest-61151143 None] Attaching volume 9e116f42-0183-4017-855b-05c8fc859c71 to instance ac45791e-b972-4814-8ba1-780e693f6cb4 at mountpoint /dev/vdb on host None. Sep 22 18:28:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5eb45e5c-4c58-4b6e-8036-895baf74c844 tempest-VolumesActionsTest-61151143 None] Attach volume completed successfully. Sep 22 18:28:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5eb45e5c-4c58-4b6e-8036-895baf74c844 tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71" released by "attach_volume" :: held 0.182s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f2c24184-22b0-47a4-b94f-f0d663fb087a tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" by "detach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f2c24184-22b0-47a4-b94f-f0d663fb087a tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f2c24184-22b0-47a4-b94f-f0d663fb087a tempest-VolumesActionsTest-61151143 None] Detaching volume 9e116f42-0183-4017-855b-05c8fc859c71 from instance ac45791e-b972-4814-8ba1-780e693f6cb4. Sep 22 18:28:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f2c24184-22b0-47a4-b94f-f0d663fb087a tempest-VolumesActionsTest-61151143 None] Detach volume completed successfully. Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f2c24184-22b0-47a4-b94f-f0d663fb087a tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "cinder-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "cinder-quobyte-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Deleting offline snapshot 8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d of volume a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] snapshot_file for this snap is: volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec982f1b-9fb5-405e-a305-48d089c83c80]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:27 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:27 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:28 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.978s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ff6bae-49a1-450e-8297-30eddb7a1321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:28:28 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc63614-cfb3-4550-9946-9fd7925634a2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:28 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 Sep 22 18:28:28 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:29 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321" returned: 0 in 0.718s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:29 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:29 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:30 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.685s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:30 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d Sep 22 18:28:30 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:30 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321.8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" returned: 0 in 0.466s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d" released by "_delete_snapshot" :: held 3.085s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_snapshot" :: held 3.140s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Created reservations ['77f16a88-220c-4d82-b58c-d83491985f1e', '4c3fd940-e942-4394-86c7-3f34dc020d86', 'ccc13935-05b7-49c1-90ce-a089308f460b', '00d615a9-dc07-444f-b858-3e17f1d69681'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:30 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Delete snapshot completed successfully. Sep 22 18:28:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98660da2-3668-43c6-bad0-029cc5c33a2f tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-8bc4767f-f4ad-4a94-b3c8-33d6c6f2310d-delete_snapshot" released by "delete_snapshot" :: held 3.477s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "cinder-a2ff6bae-49a1-450e-8297-30eddb7a1321-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-a2ff6bae-49a1-450e-8297-30eddb7a1321-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b28238-122b-403a-8eca-09a7a73a4873]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:32 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 Sep 22 18:28:32 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:32 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321" returned: 0 in 0.632s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:32 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321 Sep 22 18:28:32 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:33 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a2ff6bae-49a1-450e-8297-30eddb7a1321" returned: 0 in 0.492s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-quobyte-a2ff6bae-49a1-450e-8297-30eddb7a1321" released by "delete_volume" :: held 1.242s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Created reservations ['aa64342e-b2fc-4762-9188-68917abbda2b', '4cc51dc9-a97f-4ecb-a437-c62c0ff3cdd7', 'a4aeeffe-75ab-41b9-94ed-48f948842bdd', '0c5d15aa-7e6d-4b2f-abfb-3a8dd967e789'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:33 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:28:33 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:34 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.588s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:34 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:28:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Deleted volume successfully. Sep 22 18:28:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a1d8403b-4d83-477d-babf-b1bfce58529e tempest-SnapshotsActionsTest-729094195 None] Lock "cinder-a2ff6bae-49a1-450e-8297-30eddb7a1321-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d9a113-0d3a-4038-8186-ce5459f49784]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:35 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:28:35 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:35 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.571s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b576b5a-9187-4e53-a6f5-29d474dc593f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:36 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:28:36 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:36 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.581s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.eaab4476-0e72-43df-bd19-f07246b3528azr62wfsp.img {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:36 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.eaab4476-0e72-43df-bd19-f07246b3528azr62wfsp.img Sep 22 18:28:36 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:40 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=97,cinder:UPDATE=75,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:28:40 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=109,cinder:UPDATE=94,cinder:DELETE=8,cinder:INSERT=32 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:28:46 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.eaab4476-0e72-43df-bd19-f07246b3528azr62wfsp.img" returned: 0 in 9.604s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d0bb0-310e-4526-8cff-4aa43d4353fb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:28:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:46 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:28:46 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:47 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.975s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:47 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71, size 1024.00 MB, duration 9.60 sec, destination /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.eaab4476-0e72-43df-bd19-f07246b3528azr62wfsp.img {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:28:47 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Converted 1024.00 MB image at 106.61 MB/s Sep 22 18:28:47 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] eaab4476-0e72-43df-bd19-f07246b3528a was raw, no need to convert to raw {{(pid=86046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:28:48 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:28:48 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:28:48 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.277s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:28:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Flow 'volume_create_manager' (e5c79df9-c815-40bc-9125-05dd919e17b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3c83ee-88e2-4db7-8871-53b837b47c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3c83ee-88e2-4db7-8871-53b837b47c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c2baf4-f803-4bd9-a92d-3b702f2a6eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dfb4ca37cc4434b05054f2d9d12677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:28:52Z,use_quota=True,user_id='4f48a309f7fa4caf82e82506be6a3edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19014f7-ab8a-45f3-91b5-65c7d5cafa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19014f7-ab8a-45f3-91b5-65c7d5cafa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bde532-598c-43f3-ae0d-321e650afb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bde532-598c-43f3-ae0d-321e650afb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c2baf4-f803-4bd9-a92d-3b702f2a6eca', 'volume_name': 'volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659331b6-e9a2-4d60-899e-43a7b4631ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659331b6-e9a2-4d60-899e-43a7b4631ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86212ec8-515d-43da-a5de-5ac56954e744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:28:52 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Volume 36c2baf4-f803-4bd9-a92d-3b702f2a6eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca', 'volume_size': 1} Sep 22 18:28:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:28:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4cccc69b-3fbf-4732-9ac9-bc84adfb5860 req-c74ca088-9b58-4cdb-bebb-9fbca63baf8c tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:02 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:29:06 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=3 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.313s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Uploaded volume to glance image-id: eaab4476-0e72-43df-bd19-f07246b3528a. {{(pid=86046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.132s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c2baf4-f803-4bd9-a92d-3b702f2a6eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dfb4ca37cc4434b05054f2d9d12677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:28:52Z,use_quota=True,user_id='4f48a309f7fa4caf82e82506be6a3edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Creating volume 36c2baf4-f803-4bd9-a92d-3b702f2a6eca {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:10 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c82e56c6-557b-4932-9160-a1c43c165ea7 tempest-VolumesActionsTest-61151143 None] Copy volume to image completed successfully. Sep 22 18:29:10 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca 1073741824 Sep 22 18:29:10 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:11 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca 1073741824" returned: 0 in 0.537s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:11 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca Sep 22 18:29:11 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:11 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" returned: 0 in 0.279s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4cccc69b-3fbf-4732-9ac9-bc84adfb5860 req-c74ca088-9b58-4cdb-bebb-9fbca63baf8c tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.485s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86212ec8-515d-43da-a5de-5ac56954e744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3713b255-b0a7-4de3-8db2-79f106805465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-4cccc69b-3fbf-4732-9ac9-bc84adfb5860 req-c74ca088-9b58-4cdb-bebb-9fbca63baf8c tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Volume volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca (36c2baf4-f803-4bd9-a92d-3b702f2a6eca): created successfully Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3713b255-b0a7-4de3-8db2-79f106805465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Flow 'volume_create_manager' (e5c79df9-c815-40bc-9125-05dd919e17b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b11f8fb6-5098-4562-b149-4704a18dce31 tempest-CinderUnicodeTest-1711038821 None] Created volume successfully. Sep 22 18:29:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-4cccc69b-3fbf-4732-9ac9-bc84adfb5860 req-c74ca088-9b58-4cdb-bebb-9fbca63baf8c tempest-TestInstancesWithCinderVolumes-621238226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-843c7e24-f35a-4242-85a1-3193ac010407', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0497987-d27f-408a-b7d3-683c533f3a34', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:29:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-4cccc69b-3fbf-4732-9ac9-bc84adfb5860 req-c74ca088-9b58-4cdb-bebb-9fbca63baf8c tempest-TestInstancesWithCinderVolumes-621238226 None] attachment_update completed successfully. Sep 22 18:29:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc66d5-d1d9-474b-83ee-e2f679b44be3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:12 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:29:12 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:12 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Flow 'volume_create_manager' (dc0bc64a-56aa-479b-acdf-a1e511abf36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1731ef-c2ac-4dec-b6bd-c0e6944f40bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1731ef-c2ac-4dec-b6bd-c0e6944f40bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-439857718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d973fc-9c36-4fdd-b8f4-bba207d0a790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dfb4ca37cc4434b05054f2d9d12677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:13Z,use_quota=True,user_id='4f48a309f7fa4caf82e82506be6a3edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d78b98-d861-4b99-b943-517c70e09945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d78b98-d861-4b99-b943-517c70e09945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956cc47c-470d-4bce-a1a9-ce64093bbf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956cc47c-470d-4bce-a1a9-ce64093bbf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d973fc-9c36-4fdd-b8f4-bba207d0a790', 'volume_name': 'volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b41d3d-cacb-4cf5-a95f-2bb22cf83b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b41d3d-cacb-4cf5-a95f-2bb22cf83b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bbb971-ddf8-4e56-978f-666ce7c67064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:13 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Volume 72d973fc-9c36-4fdd-b8f4-bba207d0a790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790', 'volume_size': 1} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:13 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.756s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe51d63-0c1d-4479-b113-d26c187b5d4b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:13 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:29:13 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:13 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.522s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:13 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img Sep 22 18:29:13 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-374f33dd-5d4a-428d-b1b0-6ba45d6da6db req-6a8f8241-20eb-49a2-9a93-ba9fa31a25c1 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:20 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img" returned: 0 in 7.009s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:20 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a8b68-3348-4679-b6a6-72cea5267e6c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:20 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:29:20 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:21 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.565s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:29:21 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Converted 1024.00 MB image at 146.08 MB/s Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] df8784d8-8516-4c96-8bc1-bb4d30de599c was raw, converting to qcow2 {{(pid=86046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[803fc984-da78-4ff3-97d8-c780298b2c49]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:21 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img Sep 22 18:29:21 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:21 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img" returned: 0 in 0.335s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:21 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img Sep 22 18:29:21 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:22 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img" returned: 1 in 0.446s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:22 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h Sep 22 18:29:22 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:22 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h" returned: 0 in 0.271s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Image conversion details: src /opt/stack/data/cinder/conversion/9e116f42-0183-4017-855b-05c8fc859c71.temp_image.df8784d8-8516-4c96-8bc1-bb4d30de599co1zo0oao.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:29:22 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[36efbc4f-e65d-4360-9eb5-f116b09b9c66]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:22 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h Sep 22 18:29:22 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:22 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j6_ohg7h" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.036s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Uploaded volume to glance image-id: df8784d8-8516-4c96-8bc1-bb4d30de599c. {{(pid=86046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.332s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-439857718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d973fc-9c36-4fdd-b8f4-bba207d0a790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dfb4ca37cc4434b05054f2d9d12677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:13Z,use_quota=True,user_id='4f48a309f7fa4caf82e82506be6a3edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Creating volume 72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:24 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:24 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 1073741824 Sep 22 18:29:24 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9bb9a857-d9f9-4710-8b62-9dc765c3ba1b tempest-VolumesActionsTest-61151143 None] Copy volume to image completed successfully. Sep 22 18:29:24 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 1073741824" returned: 0 in 0.455s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:25 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 Sep 22 18:29:25 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:25 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790" returned: 0 in 0.278s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-374f33dd-5d4a-428d-b1b0-6ba45d6da6db req-6a8f8241-20eb-49a2-9a93-ba9fa31a25c1 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.350s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bbb971-ddf8-4e56-978f-666ce7c67064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25c505d-8aec-44be-b40c-703d00d55716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-374f33dd-5d4a-428d-b1b0-6ba45d6da6db req-6a8f8241-20eb-49a2-9a93-ba9fa31a25c1 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Volume volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 (72d973fc-9c36-4fdd-b8f4-bba207d0a790): created successfully Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25c505d-8aec-44be-b40c-703d00d55716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Flow 'volume_create_manager' (dc0bc64a-56aa-479b-acdf-a1e511abf36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e9c5426d-844e-4c59-9a14-cf4cf072f8cc tempest-CinderUnicodeTest-1711038821 None] Created volume successfully. Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-374f33dd-5d4a-428d-b1b0-6ba45d6da6db req-6a8f8241-20eb-49a2-9a93-ba9fa31a25c1 tempest-TestInstancesWithCinderVolumes-621238226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69f917ad-b454-401a-8f5f-40bf8b2477ef', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:29:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-374f33dd-5d4a-428d-b1b0-6ba45d6da6db req-6a8f8241-20eb-49a2-9a93-ba9fa31a25c1 tempest-TestInstancesWithCinderVolumes-621238226 None] attachment_update completed successfully. Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Acquiring lock "cinder-quobyte-9e116f42-0183-4017-855b-05c8fc859c71" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "cinder-quobyte-9e116f42-0183-4017-855b-05c8fc859c71" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7ef89-e383-4441-bb4d-8da262d60eb9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:26 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:29:26 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Creating offline snapshot 0d6a2a8b-8a1c-4d64-917d-60e45fccc159 of volume 72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14afae1-f854-4f88-8e98-97b87ba917cd]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:26 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 Sep 22 18:29:26 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:26 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.491s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:26 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71 Sep 22 18:29:26 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:26 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9e116f42-0183-4017-855b-05c8fc859c71" returned: 0 in 0.392s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "cinder-quobyte-9e116f42-0183-4017-855b-05c8fc859c71" released by "delete_volume" :: held 0.960s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:27 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790" returned: 0 in 0.643s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:27 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 1G Sep 22 18:29:27 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Created reservations ['2ccf9bc1-4229-4a26-bce2-880d509cc52d', 'bec45708-f780-4cfc-9ae1-485cfcd6bbc1', '348359e0-4351-4678-8db5-c3182bb03f6f', '65c63dbb-105f-4d84-90ee-6c6356193929'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:27 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:27 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:27 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.369s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Deleted volume successfully. Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14896af9-48f1-44ea-ba60-ca10cf1ab31d tempest-VolumesActionsTest-61151143 None] Lock "cinder-9e116f42-0183-4017-855b-05c8fc859c71-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:27 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 1G" returned: 0 in 0.644s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:27 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 Sep 22 18:29:27 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:28 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:28 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 is being set with open permissions: ugo+rw Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:28 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 Sep 22 18:29:28 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:28 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:28 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info Sep 22 18:29:28 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:28 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info" returned: 0 in 0.326s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:28 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info is being set with open permissions: ugo+rw Sep 22 18:29:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:28 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info Sep 22 18:29:28 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:29 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.info" returned: 0 in 0.292s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-194ccd44-f5db-48c5-afff-adb90eaa68b7 tempest-CinderUnicodeTest-1711038821 None] Create snapshot completed successfully Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-0d6a2a8b-8a1c-4d64-917d-60e45fccc159-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-0d6a2a8b-8a1c-4d64-917d-60e45fccc159-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-quobyte-0d6a2a8b-8a1c-4d64-917d-60e45fccc159" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-0d6a2a8b-8a1c-4d64-917d-60e45fccc159" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Deleting offline snapshot 0d6a2a8b-8a1c-4d64-917d-60e45fccc159 of volume 72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] snapshot_file for this snap is: volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4598ec4f-2f03-4dec-88d8-5ffcf6c53b99]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:29 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 Sep 22 18:29:29 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:30 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159" returned: 0 in 0.489s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9268791-5545-4150-a7c3-bc4d5f0d463e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:30 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 Sep 22 18:29:30 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:30 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790" returned: 0 in 0.496s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:30 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 Sep 22 18:29:30 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:31 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159" returned: 0 in 0.600s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:31 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159 Sep 22 18:29:31 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:31 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790.0d6a2a8b-8a1c-4d64-917d-60e45fccc159" returned: 0 in 0.396s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-15cc2ab7-f40a-41de-b5c4-1170ee8e893c req-1f05e189-ed5e-489f-82dd-eaa9baad4149 tempest-TestInstancesWithCinderVolumes-621238226 None] Terminate volume connection completed successfully. Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-15cc2ab7-f40a-41de-b5c4-1170ee8e893c req-1f05e189-ed5e-489f-82dd-eaa9baad4149 tempest-TestInstancesWithCinderVolumes-621238226 None] Deleting attachment c0497987-d27f-408a-b7d3-683c533f3a34. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-0d6a2a8b-8a1c-4d64-917d-60e45fccc159" released by "_delete_snapshot" :: held 2.193s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" released by "delete_snapshot" :: held 2.227s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Created reservations ['e3f0162f-a146-4c54-983d-50604ee7e3b4', '44f80656-d17b-4a4c-ac26-93d65563bb09', '36794c17-d1e2-4f98-94d4-e0f49f57daf7', '4e10d36e-cba6-41dc-9a9d-13c6e823760e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Delete snapshot completed successfully. Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4560c8c6-50a5-4085-8719-97180d57a67b tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-0d6a2a8b-8a1c-4d64-917d-60e45fccc159-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-843c7e24-f35a-4242-85a1-3193ac010407-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-843c7e24-f35a-4242-85a1-3193ac010407-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-quobyte-843c7e24-f35a-4242-85a1-3193ac010407" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-843c7e24-f35a-4242-85a1-3193ac010407" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[56954475-8708-415d-810e-c33dd95c8d17]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:32 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 Sep 22 18:29:32 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:33 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407" returned: 0 in 0.563s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-72d973fc-9c36-4fdd-b8f4-bba207d0a790-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:33 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407 Sep 22 18:29:33 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-72d973fc-9c36-4fdd-b8f4-bba207d0a790-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e256f3-b9ba-4694-af7d-d431daa15460]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:33 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-843c7e24-f35a-4242-85a1-3193ac010407" returned: 0 in 0.453s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-843c7e24-f35a-4242-85a1-3193ac010407" released by "delete_volume" :: held 1.067s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:33 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 Sep 22 18:29:33 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:33 devstack cinder-volume[86046]: WARNING cinder.quota [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-865503751-739851640 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-865503751-739851640, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:33 devstack cinder-volume[86046]: WARNING cinder.quota [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-865503751-739851640 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-865503751-739851640, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Created reservations ['3fc57db7-1c52-4cc3-8d76-c84c552985ee', '09b05884-53af-42f4-a668-04af912681da', '341c829c-4ed3-420b-bfe8-5de80b2724b8', '12703004-03f6-4197-93f3-38e965eab92d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:33 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:33 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:33 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790" returned: 0 in 0.630s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:34 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790 Sep 22 18:29:34 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:34 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.436s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Deleted volume successfully. Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3558e25e-061d-4bad-9c53-99fb28d7b237 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-843c7e24-f35a-4242-85a1-3193ac010407-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:34 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-72d973fc-9c36-4fdd-b8f4-bba207d0a790" returned: 0 in 0.472s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-72d973fc-9c36-4fdd-b8f4-bba207d0a790" released by "delete_volume" :: held 1.222s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Created reservations ['fac9ffd7-5fe2-4416-9910-66b427ef783a', '6994c2c1-0462-404d-b8eb-4527dcc83122', '68545e97-ba0f-4aa2-a4bf-0ac2e3037cf5', '593e9b27-ac89-4424-b538-c879291437b5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:34 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:34 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:35 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.360s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Deleted volume successfully. Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aea341f7-169b-493a-8850-87c6d8f1c9e2 tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-72d973fc-9c36-4fdd-b8f4-bba207d0a790-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-36c2baf4-f803-4bd9-a92d-3b702f2a6eca-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-36c2baf4-f803-4bd9-a92d-3b702f2a6eca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "cinder-quobyte-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8acdf76-a2fa-464d-b09c-3df20cc8e4f2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:35 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca Sep 22 18:29:35 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:36 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" returned: 0 in 0.678s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:36 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca Sep 22 18:29:36 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:36 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" returned: 0 in 0.478s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-quobyte-36c2baf4-f803-4bd9-a92d-3b702f2a6eca" released by "delete_volume" :: held 1.255s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Created reservations ['e3366299-0fe3-4ae5-9169-9f9898ebd799', '9647acee-1213-440a-a5e6-e7fac4493cb0', '8cca4b0c-f98f-4a20-a084-f224b970b667', 'a63fcbf5-f75f-47b7-80bc-05ad1e27d177'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:37 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:37 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:37 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.485s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Deleted volume successfully. Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-64598a72-a813-47f1-b4b5-1fd42a53cb1f tempest-CinderUnicodeTest-1711038821 None] Lock "cinder-36c2baf4-f803-4bd9-a92d-3b702f2a6eca-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-385b7737-a716-472a-a88b-d27c2d2a5cb6 req-8681e35f-061e-4ec4-9761-dc8024da1a8a tempest-TestInstancesWithCinderVolumes-621238226 None] Terminate volume connection completed successfully. Sep 22 18:29:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-385b7737-a716-472a-a88b-d27c2d2a5cb6 req-8681e35f-061e-4ec4-9761-dc8024da1a8a tempest-TestInstancesWithCinderVolumes-621238226 None] Deleting attachment 69f917ad-b454-401a-8f5f-40bf8b2477ef. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-f5ff07de-d0de-47df-8c8d-94fab426a9f1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-f5ff07de-d0de-47df-8c8d-94fab426a9f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-quobyte-f5ff07de-d0de-47df-8c8d-94fab426a9f1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-f5ff07de-d0de-47df-8c8d-94fab426a9f1" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d504304-3898-4786-9625-e02cb340b59e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:38 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 Sep 22 18:29:38 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:39 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1" returned: 0 in 0.604s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:39 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1 Sep 22 18:29:39 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:39 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f5ff07de-d0de-47df-8c8d-94fab426a9f1" returned: 0 in 0.329s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-f5ff07de-d0de-47df-8c8d-94fab426a9f1" released by "delete_volume" :: held 1.057s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:39 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254049943-1811151874 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254049943-1811151874, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:39 devstack cinder-volume[86046]: WARNING cinder.quota [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254049943-1811151874 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-254049943-1811151874, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Created reservations ['7c9ded80-e71e-43e6-8ef1-8e0f973510a6', 'ab7cb575-4cb9-4f1f-9798-a8fb38762a0d', '6a4cdf6a-4714-4b8a-ad7d-d7d36fc07968', '7c1c3543-4d1d-4372-a9f7-b78123916875'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:39 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:39 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:40 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.522s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Deleted volume successfully. Sep 22 18:29:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f0c91b0c-0c7b-4ddb-ad4f-a8c6a1ee050f tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-f5ff07de-d0de-47df-8c8d-94fab426a9f1-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (335a74a9-f867-48c4-b94d-e403a0f104fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc37cb-9a01-4c46-b349-7573e59f9d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12dc37cb-9a01-4c46-b349-7573e59f9d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-957070056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3942945-874a-41ef-8029-2570cb4c7192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:41Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dacae1-99a6-44ea-96ff-a49e692b8cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dacae1-99a6-44ea-96ff-a49e692b8cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5731f55a-3061-403f-90af-cff1e8e8e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5731f55a-3061-403f-90af-cff1e8e8e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3942945-874a-41ef-8029-2570cb4c7192', 'volume_name': 'volume-e3942945-874a-41ef-8029-2570cb4c7192', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178d916-19ae-495b-9e0e-7e41929110a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178d916-19ae-495b-9e0e-7e41929110a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4103517-ec90-4c08-a244-4d306f7865fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:41 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Volume e3942945-874a-41ef-8029-2570cb4c7192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3942945-874a-41ef-8029-2570cb4c7192', 'volume_size': 1} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-957070056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3942945-874a-41ef-8029-2570cb4c7192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:41Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Creating volume e3942945-874a-41ef-8029-2570cb4c7192 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:41 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:41 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 1073741824 Sep 22 18:29:41 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:29:42 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Flow 'volume_create_manager' (98e4cfd6-d9f3-4a0d-be29-5d07be60454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178523fb-d7e2-4eca-b1f5-c11ef9809906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 1073741824" returned: 0 in 1.003s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178523fb-d7e2-4eca-b1f5-c11ef9809906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1303253345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da9b408-cfb0-4f6d-9ae6-6813a8e6137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f113ab26b7477f8f4862af924695bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:42Z,use_quota=True,user_id='4e4579b9b6a4422e818a4339ef760696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb6d081-3ee9-4e3f-80e6-c81e96efbd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb6d081-3ee9-4e3f-80e6-c81e96efbd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b4c9f5-2e3c-4979-a643-54d74fdcbfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b4c9f5-2e3c-4979-a643-54d74fdcbfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da9b408-cfb0-4f6d-9ae6-6813a8e6137c', 'volume_name': 'volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a9841d-48f6-4598-9dd4-9af22434feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a9841d-48f6-4598-9dd4-9af22434feef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0c4f38-a82d-4c92-b69a-ba939ac5810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:42 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Volume 3da9b408-cfb0-4f6d-9ae6-6813a8e6137c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c', 'volume_size': 1} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:42 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 Sep 22 18:29:42 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:42 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1303253345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da9b408-cfb0-4f6d-9ae6-6813a8e6137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f113ab26b7477f8f4862af924695bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:42Z,use_quota=True,user_id='4e4579b9b6a4422e818a4339ef760696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Creating volume 3da9b408-cfb0-4f6d-9ae6-6813a8e6137c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:42 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4103517-ec90-4c08-a244-4d306f7865fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3942945-874a-41ef-8029-2570cb4c7192', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff37dc-60ab-425f-9dd4-86eb17f56f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:43 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c 1073741824 Sep 22 18:29:43 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:43 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Volume volume-e3942945-874a-41ef-8029-2570cb4c7192 (e3942945-874a-41ef-8029-2570cb4c7192): created successfully Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aff37dc-60ab-425f-9dd4-86eb17f56f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (335a74a9-f867-48c4-b94d-e403a0f104fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4c52b356-2560-41d5-9827-a8bf509e810e tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8c93d119-3ce1-4b19-bdc4-01cc54eb66b2 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192" by "attach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8c93d119-3ce1-4b19-bdc4-01cc54eb66b2 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192" acquired by "attach_volume" :: waited 0.044s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8c93d119-3ce1-4b19-bdc4-01cc54eb66b2 tempest-VolumesActionsTest-502474908 None] Attaching volume e3942945-874a-41ef-8029-2570cb4c7192 to instance 2969726b-ec6b-46df-be1e-37df8340b71e at mountpoint /dev/vdb on host None. Sep 22 18:29:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8c93d119-3ce1-4b19-bdc4-01cc54eb66b2 tempest-VolumesActionsTest-502474908 None] Attach volume completed successfully. Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8c93d119-3ce1-4b19-bdc4-01cc54eb66b2 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192" released by "attach_volume" :: held 0.278s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:43 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c 1073741824" returned: 0 in 0.883s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:43 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c Sep 22 18:29:43 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:44 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" returned: 0 in 0.630s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0c4f38-a82d-4c92-b69a-ba939ac5810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c937902-0788-41f4-9fe0-8e95d9cf13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:44 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Volume volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c (3da9b408-cfb0-4f6d-9ae6-6813a8e6137c): created successfully Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c937902-0788-41f4-9fe0-8e95d9cf13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Flow 'volume_create_manager' (98e4cfd6-d9f3-4a0d-be29-5d07be60454e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:44 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-db8d6735-1cf5-4ece-bcae-9952aed27d56 tempest-VolumesNegativeTest-601961929 None] Created volume successfully. Sep 22 18:29:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Terminate volume connection completed successfully. Sep 22 18:29:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" by "detach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Detaching volume e3942945-874a-41ef-8029-2570cb4c7192 from instance 2969726b-ec6b-46df-be1e-37df8340b71e. Sep 22 18:29:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Detach volume completed successfully. Sep 22 18:29:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f94c6912-00c9-4182-b031-61e68e1da69b tempest-VolumesActionsTest-49065526 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" released by "detach_volume" :: held 0.177s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b33091d-0b69-4a64-995c-6f6b1c88e2a6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" by "detach_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b33091d-0b69-4a64-995c-6f6b1c88e2a6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3b33091d-0b69-4a64-995c-6f6b1c88e2a6 tempest-VolumesActionsTest-502474908 None] Volume detach called, but volume not attached. Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b33091d-0b69-4a64-995c-6f6b1c88e2a6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-quobyte-e3942945-874a-41ef-8029-2570cb4c7192" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "cinder-quobyte-e3942945-874a-41ef-8029-2570cb4c7192" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c0e08-3a54-4f52-9a97-9df406d1d79b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:46 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 Sep 22 18:29:46 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:47 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-3e04feda-c3dc-464e-89c4-83714480425b req-bfd363f4-77fc-4292-9ea0-2dbe4175c4a6 tempest-TestInstancesWithCinderVolumes-621238226 None] Terminate volume connection completed successfully. Sep 22 18:29:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-3e04feda-c3dc-464e-89c4-83714480425b req-bfd363f4-77fc-4292-9ea0-2dbe4175c4a6 tempest-TestInstancesWithCinderVolumes-621238226 None] Deleting attachment 809335ea-ffe1-415a-b8d3-8445529261ca. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:29:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192" returned: 0 in 0.828s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:47 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:47 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192 Sep 22 18:29:47 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:48 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e3942945-874a-41ef-8029-2570cb4c7192" returned: 0 in 0.585s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "cinder-quobyte-e3942945-874a-41ef-8029-2570cb4c7192" released by "delete_volume" :: held 1.536s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Created reservations ['fb42a287-7c9b-44de-aab0-5218274d2cf1', '42df7fed-ebd4-4598-a00e-b7dd54885473', '2788263d-4484-44da-8412-1ecc4e550f9f', '6d6b2072-c686-42a2-b526-cda00cb90258'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:48 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:48 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:48 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:48 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:49 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.426s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Deleted volume successfully. Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-908b041d-8bd3-4aa8-b0cf-95aca0b92563 tempest-VolumesActionsTest-502474908 None] Lock "cinder-e3942945-874a-41ef-8029-2570cb4c7192-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:49 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.639s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "cinder-quobyte-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" acquired by "delete_volume" :: waited 0.045s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2b7260-de27-4e49-a39a-9df9b329023a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:50 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 Sep 22 18:29:50 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:50 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" returned: 0 in 0.628s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:50 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6 Sep 22 18:29:50 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:51 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" returned: 0 in 0.511s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-quobyte-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6" released by "delete_volume" :: held 1.238s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:51 devstack cinder-volume[86046]: WARNING cinder.quota [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1714825018-1793634110 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1714825018-1793634110, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:51 devstack cinder-volume[86046]: WARNING cinder.quota [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1714825018-1793634110 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1714825018-1793634110, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Created reservations ['289bd56c-3d62-4f2e-8ee3-033595d59bab', 'b7ea5ae2-f5eb-4605-8468-a70fae5a20cb', 'c492a255-acd2-4eea-86c1-6066fd0ab70a', '976fd5f3-c2c3-449b-9f81-bd1bad34ac30'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:51 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:51 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:51 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.292s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Deleted volume successfully. Sep 22 18:29:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a7d3326b-833a-40e4-bc26-a171d9104f09 tempest-TestInstancesWithCinderVolumes-621238226 None] Lock "cinder-6f56ac3e-3706-4ef8-b570-1c98ff86d2d6-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (399ca117-645b-45de-a76f-b02cfaa129f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf82c79-ebbe-4995-8c0e-09ecb0fdc9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf82c79-ebbe-4995-8c0e-09ecb0fdc9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901744730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e53183-f45e-4c1a-ad2d-439bab8b5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:54Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9dabe3-d6e4-4f73-9078-9369c73a8689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9dabe3-d6e4-4f73-9078-9369c73a8689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4e8dca-cc0c-41e4-8496-eb00fe014dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4e8dca-cc0c-41e4-8496-eb00fe014dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e53183-f45e-4c1a-ad2d-439bab8b5c2e', 'volume_name': 'volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d031f5-73bc-4904-b06a-b639a55499fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d031f5-73bc-4904-b06a-b639a55499fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aaa4b4-04e7-4b70-8218-8a1cea637a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Volume c1e53183-f45e-4c1a-ad2d-439bab8b5c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e', 'volume_size': 1} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901744730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e53183-f45e-4c1a-ad2d-439bab8b5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:54Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Creating volume c1e53183-f45e-4c1a-ad2d-439bab8b5c2e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:54 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e 1073741824 Sep 22 18:29:54 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:55 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e 1073741824" returned: 0 in 0.857s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:55 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e Sep 22 18:29:55 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:55 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" returned: 0 in 0.476s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aaa4b4-04e7-4b70-8218-8a1cea637a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef36c1d-45e0-40b0-8bd2-6a1eab4c0408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Volume volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e (c1e53183-f45e-4c1a-ad2d-439bab8b5c2e): created successfully Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef36c1d-45e0-40b0-8bd2-6a1eab4c0408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (399ca117-645b-45de-a76f-b02cfaa129f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6ab40473-8ae0-44c8-afdd-fe063e6ab8a6 tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "cinder-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-quobyte-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c756c50-fa00-4553-89e6-ea9a75019bf0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:29:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:56 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e Sep 22 18:29:56 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:57 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" returned: 0 in 0.465s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:57 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e Sep 22 18:29:57 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:57 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e" released by "delete_volume" :: held 0.834s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Created reservations ['52657e95-2844-4cc4-8b63-777d44465225', '10ad26bb-d0da-4cdc-815c-4cf4aa0f0433', '88c08f0a-b722-4c58-a1cd-91e37505f89d', 'd82b508f-333f-482f-9f3e-14c1232d9cc9'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:57 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:29:57 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:58 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.353s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:29:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Deleted volume successfully. Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2eef5dc-c677-4b7a-bcb3-6592fa60e0a8 tempest-VolumesActionsTest-49065526 None] Lock "cinder-c1e53183-f45e-4c1a-ad2d-439bab8b5c2e-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (eabf8bc0-c4e5-4e3c-aa97-057a0992efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44813e2-88ef-4890-96e6-0d4a9f009f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44813e2-88ef-4890-96e6-0d4a9f009f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1180495369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a29e714-ad2d-4d29-b912-c17c1a3aab88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:59Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4629f5f-734f-4648-9a7c-e50a146f1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4629f5f-734f-4648-9a7c-e50a146f1c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c14197-5ca2-4bb5-b883-c0591db446dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c14197-5ca2-4bb5-b883-c0591db446dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a29e714-ad2d-4d29-b912-c17c1a3aab88', 'volume_name': 'volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e80866c-2beb-46b4-a14b-ae35bc47e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e80866c-2beb-46b4-a14b-ae35bc47e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb9adb-9a7f-4d50-b459-15c986e6d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Volume 1a29e714-ad2d-4d29-b912-c17c1a3aab88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88', 'volume_size': 1} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1180495369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a29e714-ad2d-4d29-b912-c17c1a3aab88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:29:59Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Creating volume 1a29e714-ad2d-4d29-b912-c17c1a3aab88 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:29:58 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:29:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:58 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 1073741824 Sep 22 18:29:58 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:59 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 1073741824" returned: 0 in 0.790s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:29:59 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 Sep 22 18:29:59 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:29:59 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88" returned: 0 in 0.285s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb9adb-9a7f-4d50-b459-15c986e6d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:29:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf92b2-879e-4752-bb2e-2fd4039e4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:29:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Volume volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 (1a29e714-ad2d-4d29-b912-c17c1a3aab88): created successfully Sep 22 18:30:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf92b2-879e-4752-bb2e-2fd4039e4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (eabf8bc0-c4e5-4e3c-aa97-057a0992efe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b68b0801-e230-4837-9851-c2debad1e6b6 tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:30:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-1a29e714-ad2d-4d29-b912-c17c1a3aab88-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "cinder-1a29e714-ad2d-4d29-b912-c17c1a3aab88-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-quobyte-1a29e714-ad2d-4d29-b912-c17c1a3aab88" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-1a29e714-ad2d-4d29-b912-c17c1a3aab88" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34cbda8-a45f-4b66-911d-ea3c31b62489]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:01 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 Sep 22 18:30:01 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:01 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:01 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88 Sep 22 18:30:01 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:01 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1a29e714-ad2d-4d29-b912-c17c1a3aab88" returned: 0 in 0.287s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-1a29e714-ad2d-4d29-b912-c17c1a3aab88" released by "delete_volume" :: held 0.715s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Created reservations ['1bf94552-debe-46c2-b938-18996f405325', 'c19802cc-2098-4dc5-a6a0-33b723521519', '8b9a2a79-80fa-4ba6-8748-c9969e7754a7', 'fc42234e-9b8d-4905-a85a-cb55cf8f494f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:01 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:01 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:02 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Deleted volume successfully. Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ee1f06dc-1ebc-4c32-b165-29bddf97e68c tempest-VolumesActionsTest-49065526 None] Lock "cinder-1a29e714-ad2d-4d29-b912-c17c1a3aab88-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=9 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (601c6b89-f417-4551-85e0-0f00fc4116e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a339faf-decd-4dcb-896e-e39654eccc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a339faf-decd-4dcb-896e-e39654eccc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1898338630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8f5770-5f6e-4e32-a35d-6c76645b9793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:03Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964744ae-b909-4222-89d7-9721e776ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964744ae-b909-4222-89d7-9721e776ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5937af-d6d6-468a-a206-a95a40d934d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5937af-d6d6-468a-a206-a95a40d934d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8f5770-5f6e-4e32-a35d-6c76645b9793', 'volume_name': 'volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166c5c04-e3ea-47de-b555-44523d4ff5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166c5c04-e3ea-47de-b555-44523d4ff5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4cb16-22c5-4792-ba60-ad87d37852b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Volume eb8f5770-5f6e-4e32-a35d-6c76645b9793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793', 'volume_size': 1} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1898338630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8f5770-5f6e-4e32-a35d-6c76645b9793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:03Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Creating volume eb8f5770-5f6e-4e32-a35d-6c76645b9793 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:02 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:02 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 1073741824 Sep 22 18:30:02 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:03 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 1073741824" returned: 0 in 0.571s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:03 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 Sep 22 18:30:03 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:03 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793" returned: 0 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb4cb16-22c5-4792-ba60-ad87d37852b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68ece0f-ab42-4af1-ad8d-f7c3c6ec5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Volume volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 (eb8f5770-5f6e-4e32-a35d-6c76645b9793): created successfully Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68ece0f-ab42-4af1-ad8d-f7c3c6ec5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (601c6b89-f417-4551-85e0-0f00fc4116e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-26447386-7a09-4e93-8e90-e3d2a37667d1 tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-eb8f5770-5f6e-4e32-a35d-6c76645b9793-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "cinder-eb8f5770-5f6e-4e32-a35d-6c76645b9793-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-quobyte-eb8f5770-5f6e-4e32-a35d-6c76645b9793" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-eb8f5770-5f6e-4e32-a35d-6c76645b9793" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db48e73-8af4-40ed-b82e-e4b3a09c2809]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:05 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 Sep 22 18:30:05 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:05 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793" returned: 0 in 0.409s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:05 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793 Sep 22 18:30:05 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:05 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-eb8f5770-5f6e-4e32-a35d-6c76645b9793" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-eb8f5770-5f6e-4e32-a35d-6c76645b9793" released by "delete_volume" :: held 0.766s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Created reservations ['1efca8e9-286d-4ad7-967e-105c5260032b', '4adc822e-5709-403e-a120-54ee50443dae', 'f80cab23-511c-4176-b6a2-1fb88e5c3a2f', 'a52a2713-6b96-4bd1-bf5d-15c3c44b78af'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:06 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:06 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:06 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.271s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Deleted volume successfully. Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2f9c520f-9b31-42f5-bc4c-fa749873a301 tempest-VolumesActionsTest-49065526 None] Lock "cinder-eb8f5770-5f6e-4e32-a35d-6c76645b9793-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (0e066a8e-05c1-4d5b-893c-7f67932bb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9b356-31b8-4a50-b300-a86f227e3507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9b356-31b8-4a50-b300-a86f227e3507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109524448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae53615-fa49-40de-92fa-ff89a8a03635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:07Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d604b6a0-ec6d-4cb1-8467-0eb6f82f9bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d604b6a0-ec6d-4cb1-8467-0eb6f82f9bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c4955d-59c4-469a-a1a4-b14ce8beb32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c4955d-59c4-469a-a1a4-b14ce8beb32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae53615-fa49-40de-92fa-ff89a8a03635', 'volume_name': 'volume-fae53615-fa49-40de-92fa-ff89a8a03635', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6236d2d6-4665-4722-8065-e7d25803265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6236d2d6-4665-4722-8065-e7d25803265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa16b77-53d1-44a1-8a18-d24ebb7f06fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Volume fae53615-fa49-40de-92fa-ff89a8a03635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae53615-fa49-40de-92fa-ff89a8a03635', 'volume_size': 1} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109524448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae53615-fa49-40de-92fa-ff89a8a03635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:07Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Creating volume fae53615-fa49-40de-92fa-ff89a8a03635 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:06 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:07 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 1073741824 Sep 22 18:30:07 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:07 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 1073741824" returned: 0 in 0.505s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=116,cinder:SELECT=95,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:07 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 Sep 22 18:30:07 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:07 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635" returned: 0 in 0.286s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa16b77-53d1-44a1-8a18-d24ebb7f06fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae53615-fa49-40de-92fa-ff89a8a03635', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54130709-091e-40fc-b4d1-9f14a409b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Volume volume-fae53615-fa49-40de-92fa-ff89a8a03635 (fae53615-fa49-40de-92fa-ff89a8a03635): created successfully Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54130709-091e-40fc-b4d1-9f14a409b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (0e066a8e-05c1-4d5b-893c-7f67932bb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bef5af37-01cc-4ff3-a968-87b467ea9c73 tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-fae53615-fa49-40de-92fa-ff89a8a03635-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "cinder-fae53615-fa49-40de-92fa-ff89a8a03635-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Acquiring lock "cinder-quobyte-fae53615-fa49-40de-92fa-ff89a8a03635" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-fae53615-fa49-40de-92fa-ff89a8a03635" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b5edb6-11fe-4b6e-a13f-a92378fb3d58]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:09 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 Sep 22 18:30:09 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:09 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635" returned: 0 in 0.450s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:09 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635 Sep 22 18:30:09 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Acquiring lock "cinder-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "cinder-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Acquiring lock "cinder-quobyte-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "cinder-quobyte-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077a6a3-d2f3-4fea-9ea9-d882b777d035]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:10 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fae53615-fa49-40de-92fa-ff89a8a03635" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "cinder-quobyte-fae53615-fa49-40de-92fa-ff89a8a03635" released by "delete_volume" :: held 0.795s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:10 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c Sep 22 18:30:10 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Created reservations ['193dd0e3-0f08-4d6f-b661-277abe0d33f3', '284ab5fe-916f-417a-98af-697ea75f7dc8', 'ad817895-a2b6-4eaa-9efd-60812359d130', '8674ca0b-6494-41f6-8837-c14424c615e8'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:10 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:10 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:10 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" returned: 0 in 0.425s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:10 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c Sep 22 18:30:10 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:10 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Deleted volume successfully. Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ddb2bdbc-ddf2-43c0-9832-dd869b8ba7f1 tempest-VolumesActionsTest-49065526 None] Lock "cinder-fae53615-fa49-40de-92fa-ff89a8a03635-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:10 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" returned: 0 in 0.275s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "cinder-quobyte-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c" released by "delete_volume" :: held 0.755s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Created reservations ['c99ee7f1-39ac-4910-93e0-58f239256627', '2b59e391-bf3c-4344-9089-334b0808a3fd', '2240b589-5d39-47ca-97c6-8876ff4d3602', '9cf20808-1294-4f4e-8d9f-dafe13067ee9'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:10 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:10 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (c364b75c-48bd-4819-ba42-19b032f4ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba975b8a-5b05-4a8c-954b-ae1d157ec1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba975b8a-5b05-4a8c-954b-ae1d157ec1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208365141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:11Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaf8844-be03-49d8-8908-336d276c3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaf8844-be03-49d8-8908-336d276c3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82a8a67-cd42-4ff2-8fe2-24d601fbb51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82a8a67-cd42-4ff2-8fe2-24d601fbb51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf', 'volume_name': 'volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ea88a-ad05-45da-a5f3-1df6af8b1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ea88a-ad05-45da-a5f3-1df6af8b1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1fcba-8860-4a81-a349-556313194479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Volume 87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf', 'volume_size': 1} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208365141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ca8520736a4ccab7c1ffa3583b9b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:11Z,use_quota=True,user_id='f02dbfcfa1534a3bbdd033b083d993b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Creating volume 87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:11 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:11 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.331s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Deleted volume successfully. Sep 22 18:30:11 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf 1073741824 Sep 22 18:30:11 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-899af3de-0516-4717-86f5-71d744a189e2 tempest-VolumesNegativeTest-601961929 None] Lock "cinder-3da9b408-cfb0-4f6d-9ae6-6813a8e6137c-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:11 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf 1073741824" returned: 0 in 0.534s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:11 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf Sep 22 18:30:11 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Flow 'volume_create_manager' (0117c86f-9b56-4311-b94d-81d99612ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b8b096-e412-4a7c-9231-c4923887d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b8b096-e412-4a7c-9231-c4923887d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385a5972-842c-4be6-a92e-15665cff2171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ed239281bb4bc99ad23a0477e39b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:12Z,use_quota=True,user_id='84e77cfe30e64ce88cf8e98b2cf2c26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d4d279-c544-4905-93a3-709a5bf75deb),volume_type_id=39d4d279-c544-4905-93a3-709a5bf75deb)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1361ccb-9cf4-4145-bc95-94fac1321b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1361ccb-9cf4-4145-bc95-94fac1321b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef4c18c-6896-431c-ac40-12cc20dd7e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:11 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:30:12 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1fcba-8860-4a81-a349-556313194479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90455cfb-7f38-4ddd-b89c-639662a2fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Volume volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf (87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf): created successfully Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90455cfb-7f38-4ddd-b89c-639662a2fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Flow 'volume_create_manager' (c364b75c-48bd-4819-ba42-19b032f4ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e159612a-3373-4201-a129-abdc810774ab tempest-VolumesActionsTest-502474908 None] Created volume successfully. Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef4c18c-6896-431c-ac40-12cc20dd7e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '385a5972-842c-4be6-a92e-15665cff2171', 'volume_name': 'volume-385a5972-842c-4be6-a92e-15665cff2171', 'volume_size': 1, 'image_id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29e82a732d5c85e32052e425e927babb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58ed239281bb4bc99ad23a0477e39b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069e27b6a054ceae715542b22774df10985b8c70c35a4ddcd34bf510085cb4ad5ba2a912bdaa4ca3aa7f2836cd7e990b0407bf72dbb1811bb7ace9d0a5388410', 'id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'created_at': datetime.datetime(2026, 9, 22, 16, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 30, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95e6b6-6843-40b2-9de9-da15989ee61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95e6b6-6843-40b2-9de9-da15989ee61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb44c38-8fa3-49d6-be0e-1ca11e64fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Volume 385a5972-842c-4be6-a92e-15665cff2171: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-385a5972-842c-4be6-a92e-15665cff2171', 'volume_size': 1, 'image_id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29e82a732d5c85e32052e425e927babb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58ed239281bb4bc99ad23a0477e39b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069e27b6a054ceae715542b22774df10985b8c70c35a4ddcd34bf510085cb4ad5ba2a912bdaa4ca3aa7f2836cd7e990b0407bf72dbb1811bb7ace9d0a5388410', 'id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'created_at': datetime.datetime(2026, 9, 22, 16, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 30, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Trying to clone 385a5972-842c-4be6-a92e-15665cff2171 from image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe at location (None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:30:12 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Image download 0.00 MB at 0.00 MB/s Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65741d-0894-4b2e-a813-2d7aa38856e5]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:12 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:12 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:12 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:13 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:13 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:13 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Temporary image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe is fetched for user 84e77cfe30e64ce88cf8e98b2cf2c26b. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac550917-4820-4413-a9be-08308137fdbb]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:13 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:13 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:13 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:13 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:13 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "cinder-quobyte-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-quobyte-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e55e7-fc2f-468b-a6a9-e4365046a08e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:14 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385a5972-842c-4be6-a92e-15665cff2171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ed239281bb4bc99ad23a0477e39b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:12Z,use_quota=True,user_id='84e77cfe30e64ce88cf8e98b2cf2c26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d4d279-c544-4905-93a3-709a5bf75deb),volume_type_id=39d4d279-c544-4905-93a3-709a5bf75deb)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Creating volume 385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:14 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:14 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf Sep 22 18:30:14 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:14 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1073741824 Sep 22 18:30:14 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:14 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" returned: 0 in 0.452s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:14 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf Sep 22 18:30:14 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:14 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1073741824" returned: 0 in 0.591s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:14 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" returned: 0 in 0.343s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:14 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 Sep 22 18:30:14 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-quobyte-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf" released by "delete_volume" :: held 0.857s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Created reservations ['7ba64bc5-1034-401e-8cf6-844cd4245eb5', 'e4a018a7-62ae-4374-86d4-ec3eb681fe98', '6a9f0bdb-3640-4029-9917-de31f132faf2', '315edd35-9a26-44f5-ac41-580e7826d19e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:15 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:15 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:15 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Attempting download of 5634a69f-8d66-43ae-b5c1-a06bfd41edfe ((None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}])) to volume 385a5972-842c-4be6-a92e-15665cff2171. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef191b3d-ce23-4299-92f2-7fc98f382b02]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_ {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:15 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_ Sep 22 18:30:15 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:15 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.326s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Deleted volume successfully. Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cf4e49fc-1eb9-45fd-a10c-b41cac526fe6 tempest-VolumesActionsTest-502474908 None] Lock "cinder-87dd7a4d-b21d-4e28-a23e-3980fa5e9ebf-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:15 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_ {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:15 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_ Sep 22 18:30:15 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:16 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_" returned: 1 in 0.348s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_75mnvhr_' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae83b5-0812-4986-bd08-a5a67cde0ac5]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:16 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:16 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:16 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:16 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD Sep 22 18:30:16 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:16 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] 5634a69f-8d66-43ae-b5c1-a06bfd41edfe was raw, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:30:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:16 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 Sep 22 18:30:16 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:17 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171" returned: 0 in 0.576s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5634a69f-8d66-43ae-b5c1-a06bfd41edfe_efhwur26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:30:17 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:17 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1G Sep 22 18:30:17 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:17 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 1G" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Downloaded image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe ((None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}])) to volume 385a5972-842c-4be6-a92e-15665cff2171 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Temporary image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe for user 84e77cfe30e64ce88cf8e98b2cf2c26b is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Marking volume 385a5972-842c-4be6-a92e-15665cff2171 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Copying metadata from image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe to 385a5972-842c-4be6-a92e-15665cff2171. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Creating volume glance metadata for volume 385a5972-842c-4be6-a92e-15665cff2171 backed by image 5634a69f-8d66-43ae-b5c1-a06bfd41edfe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '29e82a732d5c85e32052e425e927babb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb44c38-8fa3-49d6-be0e-1ca11e64fa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385a5972-842c-4be6-a92e-15665cff2171', 'volume_size': 1, 'image_id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '29e82a732d5c85e32052e425e927babb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58ed239281bb4bc99ad23a0477e39b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '069e27b6a054ceae715542b22774df10985b8c70c35a4ddcd34bf510085cb4ad5ba2a912bdaa4ca3aa7f2836cd7e990b0407bf72dbb1811bb7ace9d0a5388410', 'id': '5634a69f-8d66-43ae-b5c1-a06bfd41edfe', 'created_at': datetime.datetime(2026, 9, 22, 16, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 30, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5634a69f-8d66-43ae-b5c1-a06bfd41edfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab81b24-8eb5-4fed-9d37-ad86a6d51704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:17 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Volume volume-385a5972-842c-4be6-a92e-15665cff2171 (385a5972-842c-4be6-a92e-15665cff2171): created successfully Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab81b24-8eb5-4fed-9d37-ad86a6d51704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Flow 'volume_create_manager' (0117c86f-9b56-4311-b94d-81d99612ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-633db4d8-3280-47cf-a020-971d03f93bbc tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Created volume successfully. Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Acquiring lock "cinder-385a5972-842c-4be6-a92e-15665cff2171-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "cinder-385a5972-842c-4be6-a92e-15665cff2171-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Acquiring lock "cinder-quobyte-385a5972-842c-4be6-a92e-15665cff2171" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "cinder-quobyte-385a5972-842c-4be6-a92e-15665cff2171" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f64081-3c5b-4f59-bd7e-dab84191a741]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:18 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 Sep 22 18:30:18 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:18 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171" returned: 0 in 0.488s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:19 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171 Sep 22 18:30:19 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:19 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-385a5972-842c-4be6-a92e-15665cff2171" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "cinder-quobyte-385a5972-842c-4be6-a92e-15665cff2171" released by "delete_volume" :: held 0.832s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:19 devstack cinder-volume[86046]: WARNING cinder.quota [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:30:19 devstack cinder-volume[86046]: WARNING cinder.quota [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Created reservations ['d72f32af-142e-4c81-803d-d5dc1d176332', '3d8708fb-70fa-4859-bdd4-52281b5a06e0', 'fb649695-746c-4d8b-866b-2626402706d8', '3f2eddb5-1e2c-4d96-8991-d9a1ef84b3a7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:19 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:19 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:19 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.325s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Deleted volume successfully. Sep 22 18:30:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-88511d38-d435-4142-883e-bf369333b595 tempest-VolumeAndVolumeTypeFromImageTest-452301250 None] Lock "cinder-385a5972-842c-4be6-a92e-15665cff2171-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (97d1d957-5631-4f1d-8875-0e8d3d529e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4555c78-dd64-4d9b-b0c0-e06c2fb566c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4555c78-dd64-4d9b-b0c0-e06c2fb566c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755294049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d96ebd-6046-4295-9881-45000de3cee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:24Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc89b84c-2787-4bf2-bea7-39c2c95c44a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc89b84c-2787-4bf2-bea7-39c2c95c44a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d03aee-94ef-4ffd-a4f9-6ae442d84648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d03aee-94ef-4ffd-a4f9-6ae442d84648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d96ebd-6046-4295-9881-45000de3cee0', 'volume_name': 'volume-91d96ebd-6046-4295-9881-45000de3cee0', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285d1cfa-a07c-4479-92a5-4bef6f2bc144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285d1cfa-a07c-4479-92a5-4bef6f2bc144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166638a8-6f1a-4329-9614-fe5fb99354fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:24 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume 91d96ebd-6046-4295-9881-45000de3cee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d96ebd-6046-4295-9881-45000de3cee0', 'volume_size': 1} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755294049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d96ebd-6046-4295-9881-45000de3cee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:24Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Creating volume 91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:24 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:24 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 1073741824 Sep 22 18:30:24 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:25 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 1073741824" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:25 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 Sep 22 18:30:25 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:25 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0" returned: 0 in 0.287s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166638a8-6f1a-4329-9614-fe5fb99354fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d96ebd-6046-4295-9881-45000de3cee0', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9264169b-72f2-48b6-a943-a4dc08d33650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume volume-91d96ebd-6046-4295-9881-45000de3cee0 (91d96ebd-6046-4295-9881-45000de3cee0): created successfully Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9264169b-72f2-48b6-a943-a4dc08d33650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (97d1d957-5631-4f1d-8875-0e8d3d529e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7841e08a-4018-4e44-aeb7-d513430ee29a tempest-VolumesSnapshotTestJSON-1152660831 None] Created volume successfully. Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (a5eee06c-2536-4904-85d5-676b3303dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1c4d7b-75f7-4cb5-9a0f-1d1ce302fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1c4d7b-75f7-4cb5-9a0f-1d1ce302fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995209246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d99304e-465f-4bd8-bd73-b0ab57b6f91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:27Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce836b74-a002-49cc-af73-f95e4204bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce836b74-a002-49cc-af73-f95e4204bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ade5596-a968-4eed-995e-c301b500dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ade5596-a968-4eed-995e-c301b500dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d99304e-465f-4bd8-bd73-b0ab57b6f91a', 'volume_name': 'volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a3045f-5067-492f-9daa-135c790fb835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a3045f-5067-492f-9daa-135c790fb835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1e189-9f5d-4f81-bb67-bd5b47bbf875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume 9d99304e-465f-4bd8-bd73-b0ab57b6f91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a', 'volume_size': 1} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995209246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d99304e-465f-4bd8-bd73-b0ab57b6f91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:27Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume 9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:26 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:26 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a 1073741824 Sep 22 18:30:26 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:27 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a 1073741824" returned: 0 in 0.550s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:27 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a Sep 22 18:30:27 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:27 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.437s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1e189-9f5d-4f81-bb67-bd5b47bbf875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da46655-91ea-4dd8-94ed-d5746ee4b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating offline snapshot 8fab2f0b-144f-4512-9b4f-1c10b8fff456 of volume 91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:30:27 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a (9d99304e-465f-4bd8-bd73-b0ab57b6f91a): created successfully Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da46655-91ea-4dd8-94ed-d5746ee4b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (a5eee06c-2536-4904-85d5-676b3303dad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989b24f-3fb4-42e9-af8d-e1737f863dae]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d8372e99-cb4d-426b-97ac-5f59b55c6732 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:27 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 Sep 22 18:30:27 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:28 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0" returned: 0 in 0.446s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:28 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 1G Sep 22 18:30:28 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:28 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 1G" returned: 0 in 0.406s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d96ebd-6046-4295-9881-45000de3cee0 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:28 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d96ebd-6046-4295-9881-45000de3cee0 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 Sep 22 18:30:28 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:28 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d96ebd-6046-4295-9881-45000de3cee0 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456" returned: 0 in 0.398s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:28 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 is being set with open permissions: ugo+rw Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:28 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 Sep 22 18:30:28 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:29 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456" returned: 0 in 0.280s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:29 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info Sep 22 18:30:29 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:29 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:29 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info is being set with open permissions: ugo+rw Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:29 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info Sep 22 18:30:29 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:29 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.info" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.790s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating offline snapshot a070f6aa-8a46-4e49-9bbc-8be979ebb0cf of volume 9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d1b17-c82e-4e81-bdf0-aab60077aeb4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3fbde693-3cad-421a-aab0-a0dae4d42a86 tempest-VolumesSnapshotTestJSON-1152660831 None] Create snapshot completed successfully Sep 22 18:30:29 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a Sep 22 18:30:29 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:30 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:30 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf 1G Sep 22 18:30:30 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-8fab2f0b-144f-4512-9b4f-1c10b8fff456-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-8fab2f0b-144f-4512-9b4f-1c10b8fff456-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-8fab2f0b-144f-4512-9b4f-1c10b8fff456" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-8fab2f0b-144f-4512-9b4f-1c10b8fff456" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Deleting offline snapshot 8fab2f0b-144f-4512-9b4f-1c10b8fff456 of volume 91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] snapshot_file for this snap is: volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2d635-3ec9-46d8-a5d2-1afef299b98b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:30 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf 1G" returned: 0 in 0.484s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:30 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf Sep 22 18:30:30 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:30 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 Sep 22 18:30:30 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:30 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456" returned: 0 in 0.407s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d96ebd-6046-4295-9881-45000de3cee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:30:31 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" returned: 0 in 0.347s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf is being set with open permissions: ugo+rw Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fd8c8-a08c-4051-9778-6573300f8c0b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf Sep 22 18:30:31 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 Sep 22 18:30:31 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info Sep 22 18:30:31 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 Sep 22 18:30:31 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info is being set with open permissions: ugo+rw Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info Sep 22 18:30:31 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:31 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.info" returned: 0 in 0.299s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:31 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456 Sep 22 18:30:31 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a95eef3c-ad29-4eec-bb6e-581320bb1871 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Create snapshot completed successfully Sep 22 18:30:32 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0.8fab2f0b-144f-4512-9b4f-1c10b8fff456" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-8fab2f0b-144f-4512-9b4f-1c10b8fff456" released by "_delete_snapshot" :: held 1.669s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" released by "delete_snapshot" :: held 1.696s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['618398d5-bcad-48b2-942a-909386566631', '8984746c-eae7-491e-8076-c40fe0df0613', 'fc65e31f-e6fd-4012-916d-c40760651172', 'c6c09216-d9a0-48fc-8aa4-0a77e553bece'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Delete snapshot completed successfully. Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-915db0f8-ee72-4fb8-a53b-d9f7543a3bcd tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-8fab2f0b-144f-4512-9b4f-1c10b8fff456-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (6bc9ede8-d01d-45f1-ab6a-b4e81d044e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed16af18-b4ea-49d6-953e-eca9321498f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed16af18-b4ea-49d6-953e-eca9321498f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108949615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bccd7e3-c561-46bf-a7ea-5a5a727db0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:33Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4fe0eb-db34-45bb-b870-3ea9424e1c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4fe0eb-db34-45bb-b870-3ea9424e1c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c388895e-c9e6-4482-9379-91611415f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c388895e-c9e6-4482-9379-91611415f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bccd7e3-c561-46bf-a7ea-5a5a727db0de', 'volume_name': 'volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c312500b-c6f3-4961-9220-464b8ecf71b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c312500b-c6f3-4961-9220-464b8ecf71b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c366b7-ffe1-425b-9305-b11e3eed40d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:32 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume 0bccd7e3-c561-46bf-a7ea-5a5a727db0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de', 'volume_size': 1} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108949615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bccd7e3-c561-46bf-a7ea-5a5a727db0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:33Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume 0bccd7e3-c561-46bf-a7ea-5a5a727db0de {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:32 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:32 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de 1073741824 Sep 22 18:30:32 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (5fe05036-90fc-41e3-bdc0-7beb64212c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd138c4-c8d0-45f6-824a-ae6e26e646d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd138c4-c8d0-45f6-824a-ae6e26e646d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709399481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58675bc-6f20-4cf8-ab19-1f2507f4ad14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:33Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91e03a-d3ed-45e5-9fe9-58617382a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91e03a-d3ed-45e5-9fe9-58617382a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d83e077-93ff-4bef-935e-9b5eef81ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d83e077-93ff-4bef-935e-9b5eef81ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58675bc-6f20-4cf8-ab19-1f2507f4ad14', 'volume_name': 'volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3efa013-ee2e-4132-af9d-d06eae27b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3efa013-ee2e-4132-af9d-d06eae27b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e4e0ed-44b2-4ed0-8f02-de26e2999451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume f58675bc-6f20-4cf8-ab19-1f2507f4ad14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14', 'volume_size': 1} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:33 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de 1073741824" returned: 0 in 0.704s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:33 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de Sep 22 18:30:33 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (14023444-cb87-4bed-a516-f80cba28f75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab6c0c-5423-42de-8caf-f44c698f36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab6c0c-5423-42de-8caf-f44c698f36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065177491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b6b6bb-1db5-47fe-ab97-1842b4999182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccde5196-3b97-4fb7-a70d-59747742460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccde5196-3b97-4fb7-a70d-59747742460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48689357-3c0d-4d7d-af78-ec5ef5ef3d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48689357-3c0d-4d7d-af78-ec5ef5ef3d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b6b6bb-1db5-47fe-ab97-1842b4999182', 'volume_name': 'volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382a8571-43df-45a7-9f18-dea657dd4ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382a8571-43df-45a7-9f18-dea657dd4ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2919931d-5eb3-4f66-b523-589caa43bd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume e8b6b6bb-1db5-47fe-ab97-1842b4999182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182', 'volume_size': 1} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:33 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" returned: 0 in 0.352s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709399481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58675bc-6f20-4cf8-ab19-1f2507f4ad14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:33Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume f58675bc-6f20-4cf8-ab19-1f2507f4ad14 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:33 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c366b7-ffe1-425b-9305-b11e3eed40d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 1073741824 Sep 22 18:30:33 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3012680b-2684-432e-bb71-ec01fafd5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de (0bccd7e3-c561-46bf-a7ea-5a5a727db0de): created successfully Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3012680b-2684-432e-bb71-ec01fafd5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (6bc9ede8-d01d-45f1-ab6a-b4e81d044e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:33 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-327887b5-0c38-4b0d-a87f-cf62862fd32d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (3160e2cc-e41d-45be-8576-fcd4cb649213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf65396-3631-4320-816a-d9d52cf951f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf65396-3631-4320-816a-d9d52cf951f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1724865855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03188673-4c96-468f-9f6a-1dcd9be780ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bb9b0a-6a7b-4ebd-81e7-15d65365d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bb9b0a-6a7b-4ebd-81e7-15d65365d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cd0e57-652d-4fdb-a37d-d1dbe6338628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cd0e57-652d-4fdb-a37d-d1dbe6338628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03188673-4c96-468f-9f6a-1dcd9be780ec', 'volume_name': 'volume-03188673-4c96-468f-9f6a-1dcd9be780ec', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b7f873-3ee7-443c-ab32-0cfaefe8fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b7f873-3ee7-443c-ab32-0cfaefe8fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0186db4-3cc8-4869-adc8-79042f7d2392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume 03188673-4c96-468f-9f6a-1dcd9be780ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03188673-4c96-468f-9f6a-1dcd9be780ec', 'volume_size': 1} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (ddf99e80-50f4-49fb-9e96-74146673d385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e76ce7-9371-4642-9a7b-e8f09ae79d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e76ce7-9371-4642-9a7b-e8f09ae79d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640647748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b58cfc-5b0c-48bc-871b-beb061b51a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1879532b-6af7-4647-b55c-7360d60fd22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1879532b-6af7-4647-b55c-7360d60fd22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c542818d-7d1f-4f7c-9e82-028cbf4d2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c542818d-7d1f-4f7c-9e82-028cbf4d2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b58cfc-5b0c-48bc-871b-beb061b51a23', 'volume_name': 'volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d87ee8b-48c9-4c2d-836d-b93a8422ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d87ee8b-48c9-4c2d-836d-b93a8422ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97e789-6c8f-45d8-ab0d-464fbb0b4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume a0b58cfc-5b0c-48bc-871b-beb061b51a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23', 'volume_size': 1} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:34 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 1073741824" returned: 0 in 0.588s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:34 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 Sep 22 18:30:34 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:34 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065177491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b6b6bb-1db5-47fe-ab97-1842b4999182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume e8b6b6bb-1db5-47fe-ab97-1842b4999182 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:34 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 1073741824 Sep 22 18:30:34 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (8e5a679a-25eb-404a-a48b-b8d0454aaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e7008e-1327-40f5-8b84-7d33b1e9e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e7008e-1327-40f5-8b84-7d33b1e9e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775884284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80345e99-0f04-40ea-ad96-2640f1ebfbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:35Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ddb2d1-efb0-43db-a841-18010e161d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ddb2d1-efb0-43db-a841-18010e161d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cd3c64-ee05-41d1-882a-4a2b4188f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cd3c64-ee05-41d1-882a-4a2b4188f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80345e99-0f04-40ea-ad96-2640f1ebfbbe', 'volume_name': 'volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540e7687-514d-44b9-bd0e-5246831117ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540e7687-514d-44b9-bd0e-5246831117ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c7650-44de-447d-86dc-2634fb8436aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume 80345e99-0f04-40ea-ad96-2640f1ebfbbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe', 'volume_size': 1} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e4e0ed-44b2-4ed0-8f02-de26e2999451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d102b6f-9200-4d5a-a330-ce208d35e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 (f58675bc-6f20-4cf8-ab19-1f2507f4ad14): created successfully Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d102b6f-9200-4d5a-a330-ce208d35e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (5fe05036-90fc-41e3-bdc0-7beb64212c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6509cbc6-e323-40dd-88c7-05e251e05431 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:35 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 1073741824" returned: 0 in 0.535s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:35 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 Sep 22 18:30:35 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:35 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182" returned: 0 in 0.272s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1724865855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03188673-4c96-468f-9f6a-1dcd9be780ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Creating volume 03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:35 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:35 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec 1073741824 Sep 22 18:30:35 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2919931d-5eb3-4f66-b523-589caa43bd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80973b07-d60f-4aaf-a9cc-5bfd36947ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 (e8b6b6bb-1db5-47fe-ab97-1842b4999182): created successfully Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80973b07-d60f-4aaf-a9cc-5bfd36947ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (14023444-cb87-4bed-a516-f80cba28f75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-252a195b-f1fa-4a00-a9dc-5ee4dc10cb2c tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:36 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec 1073741824" returned: 0 in 0.540s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:36 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:36 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:36 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640647748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b58cfc-5b0c-48bc-871b-beb061b51a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:34Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume a0b58cfc-5b0c-48bc-871b-beb061b51a23 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:36 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0186db4-3cc8-4869-adc8-79042f7d2392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03188673-4c96-468f-9f6a-1dcd9be780ec', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97df2088-4964-497c-a7e7-c273c27ed811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:36 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 1073741824 Sep 22 18:30:36 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Volume volume-03188673-4c96-468f-9f6a-1dcd9be780ec (03188673-4c96-468f-9f6a-1dcd9be780ec): created successfully Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97df2088-4964-497c-a7e7-c273c27ed811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (3160e2cc-e41d-45be-8576-fcd4cb649213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-95efe878-b4b8-4fd7-84eb-a1f3b07f914a tempest-VolumesSnapshotTestJSON-1152660831 None] Created volume successfully. Sep 22 18:30:37 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 1073741824" returned: 0 in 0.536s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:37 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 Sep 22 18:30:37 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:37 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.440s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1775884284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80345e99-0f04-40ea-ad96-2640f1ebfbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebc20d6ff94232963e4041397fff5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:35Z,use_quota=True,user_id='87d01845a0df4f88959e2cf38aa17d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Creating volume 80345e99-0f04-40ea-ad96-2640f1ebfbbe {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:37 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97e789-6c8f-45d8-ab0d-464fbb0b4e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:37 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe 1073741824 Sep 22 18:30:37 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868f25e7-60c2-4cfe-a56f-93b981d23c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:37 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 (a0b58cfc-5b0c-48bc-871b-beb061b51a23): created successfully Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868f25e7-60c2-4cfe-a56f-93b981d23c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (ddf99e80-50f4-49fb-9e96-74146673d385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cf009a7f-1374-46cc-a842-3b724c3c9f0d tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:37 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe 1073741824" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:37 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe Sep 22 18:30:37 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:38 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.978s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating offline snapshot 0d46d4a0-5e94-4d32-b03d-3469a80f3793 of volume 03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c7650-44de-447d-86dc-2634fb8436aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3040b491-08c5-401b-80cc-da82d312ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[846d6a8d-51af-47ff-9b89-b88f4b5ee54b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:38 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Volume volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe (80345e99-0f04-40ea-ad96-2640f1ebfbbe): created successfully Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3040b491-08c5-401b-80cc-da82d312ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Flow 'volume_create_manager' (8e5a679a-25eb-404a-a48b-b8d0454aaec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-24ad88b5-483f-4803-88ad-1f54e6c8c09f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created volume successfully. Sep 22 18:30:38 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:38 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:38 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.371s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:38 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 1G Sep 22 18:30:38 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Flow 'volume_create_manager' (a39ea751-32bb-4562-97c9-49f1a19d5091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299e68e3-c0a3-49d3-895f-c508b1813650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299e68e3-c0a3-49d3-895f-c508b1813650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1697963235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5911fe-d429-4a2b-85dc-d3a90a9d3e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebcaeece6ef4031ad90cce466920291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:39Z,use_quota=True,user_id='2d71b488172843ffb7ecb22213ac56f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7562fe5d-5fd6-4ef5-a631-be5331526f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7562fe5d-5fd6-4ef5-a631-be5331526f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6c7c6b-62c2-4758-9675-e1af753d2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6c7c6b-62c2-4758-9675-e1af753d2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5911fe-d429-4a2b-85dc-d3a90a9d3e49', 'volume_name': 'volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfe7993-f5b9-4721-a01d-c84c48a0af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfe7993-f5b9-4721-a01d-c84c48a0af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0871a3-6ff3-4d56-b319-d7b3f88568c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:38 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Volume fb5911fe-d429-4a2b-85dc-d3a90a9d3e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49', 'volume_size': 1} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:38 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 1G" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03188673-4c96-468f-9f6a-1dcd9be780ec -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:38 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03188673-4c96-468f-9f6a-1dcd9be780ec -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:38 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-80345e99-0f04-40ea-ad96-2640f1ebfbbe-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:39 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03188673-4c96-468f-9f6a-1dcd9be780ec -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.315s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 is being set with open permissions: ugo+rw Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-80345e99-0f04-40ea-ad96-2640f1ebfbbe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:39 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:39 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-80345e99-0f04-40ea-ad96-2640f1ebfbbe" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-80345e99-0f04-40ea-ad96-2640f1ebfbbe" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a39dfc8-9110-4c79-afde-9e130615c568]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:39 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe Sep 22 18:30:39 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:39 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info Sep 22 18:30:39 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:39 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe Sep 22 18:30:39 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:39 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info is being set with open permissions: ugo+rw Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:39 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info Sep 22 18:30:39 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:39 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-80345e99-0f04-40ea-ad96-2640f1ebfbbe" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-80345e99-0f04-40ea-ad96-2640f1ebfbbe" released by "delete_volume" :: held 0.680s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:40 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.info" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1697963235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5911fe-d429-4a2b-85dc-d3a90a9d3e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebcaeece6ef4031ad90cce466920291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:39Z,use_quota=True,user_id='2d71b488172843ffb7ecb22213ac56f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Creating volume fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:40 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['60dec9a0-0dfb-4f35-ab69-68056eb97d93', '1ba37208-621b-4ec2-ac1b-d58f26a3824d', '32c4820c-1818-4cd5-8217-f902beb0f368', '0a82386b-4059-44fc-9ef4-03e6a20f56c6'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:40 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 1073741824 Sep 22 18:30:40 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-af63908f-4e06-4433-8094-0026d7527db9 tempest-VolumesSnapshotTestJSON-1152660831 None] Create snapshot completed successfully Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:40 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:40 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-a0b58cfc-5b0c-48bc-871b-beb061b51a23-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-a0b58cfc-5b0c-48bc-871b-beb061b51a23-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:40 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-a0b58cfc-5b0c-48bc-871b-beb061b51a23" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a99c54b6-93aa-41a9-b085-1862cb025a6b tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-80345e99-0f04-40ea-ad96-2640f1ebfbbe-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-a0b58cfc-5b0c-48bc-871b-beb061b51a23" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e607f66-6dcf-4553-ab48-62d605b981bf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:40 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 1073741824" returned: 0 in 0.530s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:40 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 Sep 22 18:30:40 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:40 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 Sep 22 18:30:40 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:40 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" returned: 0 in 0.286s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0871a3-6ff3-4d56-b319-d7b3f88568c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eb1e5f-3f88-4900-829b-56a771f824db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:40 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Volume volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 (fb5911fe-d429-4a2b-85dc-d3a90a9d3e49): created successfully Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eb1e5f-3f88-4900-829b-56a771f824db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Flow 'volume_create_manager' (a39ea751-32bb-4562-97c9-49f1a19d5091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:41 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23" returned: 0 in 0.436s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6bcd2bcc-ec74-4c52-a409-c395c9efc0d8 tempest-VolumesTransfersV357Test-1968344264 None] Created volume successfully. Sep 22 18:30:41 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23 Sep 22 18:30:41 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (8fa9dd6c-44f0-48cd-9225-9d0f4f16ca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc829f5-8728-42e3-973a-c43fe64545b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc829f5-8728-42e3-973a-c43fe64545b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1807307175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea694f3c-ecae-4c85-bf4b-0291625434cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0d46d4a0-5e94-4d32-b03d-3469a80f3793,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:41Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d102026-b23b-47ae-b52a-fd46f15b5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d102026-b23b-47ae-b52a-fd46f15b5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1bd2b3-b0cf-4109-8781-469e6fff1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1bd2b3-b0cf-4109-8781-469e6fff1b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea694f3c-ecae-4c85-bf4b-0291625434cd', 'volume_name': 'volume-ea694f3c-ecae-4c85-bf4b-0291625434cd', 'volume_size': 2, 'snapshot_id': '0d46d4a0-5e94-4d32-b03d-3469a80f3793'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fe0fc-40a3-466d-957d-bf497ddc5b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fe0fc-40a3-466d-957d-bf497ddc5b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca872b0-92b8-4d7f-9ec2-b9cac9a55952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:41 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume ea694f3c-ecae-4c85-bf4b-0291625434cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea694f3c-ecae-4c85-bf4b-0291625434cd', 'volume_size': 2, 'snapshot_id': '0d46d4a0-5e94-4d32-b03d-3469a80f3793'} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793-ea694f3c-ecae-4c85-bf4b-0291625434cd" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793-ea694f3c-ecae-4c85-bf4b-0291625434cd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating volume ea694f3c-ecae-4c85-bf4b-0291625434cd from snapshot 0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] snapshot: 0d46d4a0-5e94-4d32-b03d-3469a80f3793, volume: ea694f3c-ecae-4c85-bf4b-0291625434cd, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96421df-5ae9-4d66-8c11-86c3d30353e9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:41 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a0b58cfc-5b0c-48bc-871b-beb061b51a23" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-a0b58cfc-5b0c-48bc-871b-beb061b51a23" released by "delete_volume" :: held 0.750s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:41 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:41 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['a4452ac8-3aab-428e-b8a0-65f291283dc6', '382f8ff4-c4aa-4f9c-b4e7-a73be0cd9b76', '79259522-3a7f-4490-a79f-c8e75d3d0ca5', 'ef71d1f3-18c8-4a83-b7b0-18bd014e6533'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:41 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:41 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:41 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-e8b6b6bb-1db5-47fe-ab97-1842b4999182-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.406s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03188673-4c96-468f-9f6a-1dcd9be780ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-e8b6b6bb-1db5-47fe-ab97-1842b4999182-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[22325e8d-b847-4ce3-b588-14295a24a315]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:41 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-e8b6b6bb-1db5-47fe-ab97-1842b4999182" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-e8b6b6bb-1db5-47fe-ab97-1842b4999182" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-267d5844-b7af-491c-99c7-daa128d387a9 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-a0b58cfc-5b0c-48bc-871b-beb061b51a23-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce64401-74eb-406d-86eb-2f867373dbcc]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:41 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:41 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:41 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 Sep 22 18:30:41 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:42 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.406s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:42 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd Sep 22 18:30:42 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:42 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182" returned: 0 in 0.441s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:42 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182 Sep 22 18:30:42 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:42 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e8b6b6bb-1db5-47fe-ab97-1842b4999182" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-e8b6b6bb-1db5-47fe-ab97-1842b4999182" released by "delete_volume" :: held 0.791s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['fdac3b6b-3478-48d9-b661-706789a02d21', '300adc71-6d88-4e6a-8174-14449a815446', '39d5db9c-470a-44ba-9943-916bdb562559', '5954093e-7646-4fb9-a1c8-75540c55af28'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:42 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:42 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-efadf89e-f2fc-40f9-9c48-3330b60656f1 tempest-VolumesTransfersV357Test-492532014 None] Transfer volume completed successfully. Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-f58675bc-6f20-4cf8-ab19-1f2507f4ad14-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-f58675bc-6f20-4cf8-ab19-1f2507f4ad14-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:43 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" acquired by "delete_volume" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.472s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5523a084-ec6d-4201-852e-519435efa0f1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b6ea6fb0-e580-4042-a7eb-d2b9cc53e90f tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-e8b6b6bb-1db5-47fe-ab97-1842b4999182-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:43 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 Sep 22 18:30:43 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:44 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" returned: 0 in 0.772s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:44 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14 Sep 22 18:30:44 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "cinder-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "cinder-quobyte-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-quobyte-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" acquired by "delete_volume" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6144bc9-df7b-4bd8-a69d-27147ac2afcc]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:44 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" returned: 0 in 0.546s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:44 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 Sep 22 18:30:44 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-f58675bc-6f20-4cf8-ab19-1f2507f4ad14" released by "delete_volume" :: held 1.471s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['8057b954-e468-430d-8b33-aadfd8f31773', '64d493d5-8ba7-4b51-b089-dcc0a7de2417', '76df0f31-8ac5-4025-bfda-e5a13c5f527e', 'b13c2388-009b-4df4-9dd3-c45ea6d909db'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:44 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:44 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:45 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" returned: 0 in 0.926s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:45 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49 Sep 22 18:30:45 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:45 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.526s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-73bd009f-228e-4bae-9f37-70fb8c17c1e0 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-f58675bc-6f20-4cf8-ab19-1f2507f4ad14-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-0bccd7e3-c561-46bf-a7ea-5a5a727db0de-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-0bccd7e3-c561-46bf-a7ea-5a5a727db0de-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b434eef-e3f5-4bc8-a3ae-b6ba6d2fa3f6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:45 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" returned: 0 in 0.502s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-quobyte-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49" released by "delete_volume" :: held 1.517s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:45 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de Sep 22 18:30:45 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Created reservations ['0e9a0fc5-6964-4c50-a694-a70d2bad6a4e', '11dda989-e794-4d49-a4a5-cac5fcd56509', 'c91c4316-9f33-4c37-80e2-7b35ede1957d', 'c561c7ed-ef18-4b57-9ff4-e64079b08fc1'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:46 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:46 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:46 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" returned: 0 in 0.600s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:46 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de Sep 22 18:30:46 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:46 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Deleted volume successfully. Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aa333d7d-eca0-4d8b-8579-4974e6097446 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-fb5911fe-d429-4a2b-85dc-d3a90a9d3e49-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:46 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-0bccd7e3-c561-46bf-a7ea-5a5a727db0de" released by "delete_volume" :: held 1.083s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['70f23fea-7d91-45e9-afa8-58e4f0297ccb', 'e8c6a3da-0f27-438c-88ea-12291ff902a7', '71a0fe32-ac3c-4c05-b091-07c0154fa646', '6a1a47b6-774f-4981-9cd8-3f52bc41454f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:47 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:47 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Flow 'volume_create_manager' (dd1d24f9-12b4-446f-8914-dc049d9cedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a57a8f3-b2b4-4848-a1ae-92a3dd052218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:47 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a57a8f3-b2b4-4848-a1ae-92a3dd052218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1228308080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8906bc88-5373-4069-841a-dedb196f320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebcaeece6ef4031ad90cce466920291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:47Z,use_quota=True,user_id='2d71b488172843ffb7ecb22213ac56f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280250aa-0e4e-44b5-855f-411870f29fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280250aa-0e4e-44b5-855f-411870f29fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b93fe3-f9a9-4722-a72d-7c0d38af0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b93fe3-f9a9-4722-a72d-7c0d38af0b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8906bc88-5373-4069-841a-dedb196f320a', 'volume_name': 'volume-8906bc88-5373-4069-841a-dedb196f320a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bb6751-7655-4a5d-86bc-214fe98ff6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bb6751-7655-4a5d-86bc-214fe98ff6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9fb641-0d77-4c76-a739-e99c26ab9669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Volume 8906bc88-5373-4069-841a-dedb196f320a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8906bc88-5373-4069-841a-dedb196f320a', 'volume_size': 1} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.630s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:47 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-842820d4-0e45-4596-9659-6908d6f5172a tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-0bccd7e3-c561-46bf-a7ea-5a5a727db0de-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleting offline snapshot a070f6aa-8a46-4e49-9bbc-8be979ebb0cf of volume 9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] snapshot_file for this snap is: volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8585a661-b0a7-45df-b43b-ef42ff4834d4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:48 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf Sep 22 18:30:48 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:48 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:48 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:48 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" returned: 0 in 0.670s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7866a24-4658-4eb8-85d3-5132e69e7a0e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:49 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.446s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 28 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:30:49 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a Sep 22 18:30:49 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:49 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" returned: 0 in 0.566s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:49 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf Sep 22 18:30:49 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:49 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd" returned: 0 in 7.793s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:30:49 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Converted 1024.00 MB image at 131.36 MB/s Sep 22 18:30:49 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd is being set with open permissions: ugo+rw Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:49 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd Sep 22 18:30:49 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:49 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" returned: 0 in 0.546s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:50 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf Sep 22 18:30:50 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:50 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" released by "_copy_volume_from_snapshot" :: held 8.957s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793-ea694f3c-ecae-4c85-bf4b-0291625434cd" released by "_create_volume_from_snapshot" :: held 9.025s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.040s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1228308080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8906bc88-5373-4069-841a-dedb196f320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebcaeece6ef4031ad90cce466920291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:47Z,use_quota=True,user_id='2d71b488172843ffb7ecb22213ac56f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Creating volume 8906bc88-5373-4069-841a-dedb196f320a {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:50 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a 1073741824 Sep 22 18:30:50 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca872b0-92b8-4d7f-9ec2-b9cac9a55952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea694f3c-ecae-4c85-bf4b-0291625434cd', 'volume_size': 2, 'snapshot_id': '0d46d4a0-5e94-4d32-b03d-3469a80f3793'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e74a24-0a74-4a88-8d03-95d7c9907c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:50 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a.a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" returned: 0 in 0.270s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume volume-ea694f3c-ecae-4c85-bf4b-0291625434cd (ea694f3c-ecae-4c85-bf4b-0291625434cd): created successfully Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e74a24-0a74-4a88-8d03-95d7c9907c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (8fa9dd6c-44f0-48cd-9225-9d0f4f16ca17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf" released by "_delete_snapshot" :: held 2.268s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-719d1737-751f-4d46-93aa-602b155b7766 tempest-VolumesSnapshotTestJSON-1152660831 None] Created volume successfully. Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" released by "delete_snapshot" :: held 2.304s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['df6db3a2-0e27-42f2-a1c3-418aab368bb5', 'aa60222e-afa0-435d-9bb3-0d161bd8b9b3', '01d43f78-0f36-4edb-aa2c-9145830c4ced', 'c3de35a0-cbd7-4cc3-bd4b-ce65649f7b70'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Delete snapshot completed successfully. Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8eb13309-3592-4874-9032-c6b77d3682eb tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-a070f6aa-8a46-4e49-9bbc-8be979ebb0cf-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:50 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a 1073741824" returned: 0 in 0.432s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:50 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a Sep 22 18:30:50 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:50 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9fb641-0d77-4c76-a739-e99c26ab9669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8906bc88-5373-4069-841a-dedb196f320a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa60866f-21bf-4f41-9a2c-306b4474ac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Volume volume-8906bc88-5373-4069-841a-dedb196f320a (8906bc88-5373-4069-841a-dedb196f320a): created successfully Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa60866f-21bf-4f41-9a2c-306b4474ac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Flow 'volume_create_manager' (dd1d24f9-12b4-446f-8914-dc049d9cedc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8f5eb100-c36f-4465-a4a9-26ad46db4dad tempest-VolumesTransfersV357Test-1968344264 None] Created volume successfully. Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-ea694f3c-ecae-4c85-bf4b-0291625434cd-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-ea694f3c-ecae-4c85-bf4b-0291625434cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c2a8a-bb6b-48cf-8c42-9d9a713fd1ec]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:51 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd Sep 22 18:30:51 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-9d99304e-465f-4bd8-bd73-b0ab57b6f91a-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-9d99304e-465f-4bd8-bd73-b0ab57b6f91a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9aa848-be7d-44b6-be01-f4817c1d2256]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:51 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd" returned: 0 in 0.379s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:51 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd Sep 22 18:30:51 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:51 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a Sep 22 18:30:51 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:51 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ea694f3c-ecae-4c85-bf4b-0291625434cd" returned: 0 in 0.251s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-ea694f3c-ecae-4c85-bf4b-0291625434cd" released by "delete_volume" :: held 0.673s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:51 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:51 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a Sep 22 18:30:51 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['5aa1e952-2b86-4421-9776-e3ca383f4e6c', '3f840899-0324-44bb-9a86-7aab47c7089d', '6cbec653-f608-4aeb-af55-e5e658879da2', '7897de66-fc7b-4709-969e-51075223ecdf'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:51 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:51 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "cinder-8906bc88-5373-4069-841a-dedb196f320a-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-8906bc88-5373-4069-841a-dedb196f320a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "cinder-quobyte-8906bc88-5373-4069-841a-dedb196f320a" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-quobyte-8906bc88-5373-4069-841a-dedb196f320a" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:52 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" returned: 0 in 0.352s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dbe820-79fe-4d7b-93a3-253972486df5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-quobyte-9d99304e-465f-4bd8-bd73-b0ab57b6f91a" released by "delete_volume" :: held 0.807s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Created reservations ['4883f1cb-5aba-441c-8bb5-9deb0c2f459a', 'cb95486f-9b1d-4807-ac7e-5098d431b1b1', '75135a2a-fa09-4643-9995-9b9dfd738f7b', '1ed93e3b-9138-4bf3-b75e-bf021169039f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-0d46d4a0-5e94-4d32-b03d-3469a80f3793-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:52 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a Sep 22 18:30:52 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-0d46d4a0-5e94-4d32-b03d-3469a80f3793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:52 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Deleted volume successfully. Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleting offline snapshot 0d46d4a0-5e94-4d32-b03d-3469a80f3793 of volume 03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] snapshot_file for this snap is: volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ebe35-c505-4bc7-962b-c10175ee4dbf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a29725c8-6dd1-4c63-aa1f-ba6c31ba244f tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-ea694f3c-ecae-4c85-bf4b-0291625434cd-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:52 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:52 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:52 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:52 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:52 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:52 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a Sep 22 18:30:52 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:52 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.298s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Deleted volume successfully. Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ad7b495-e92f-48a6-a75b-727836a53409 tempest-CreateVolumesFromSnapshotTest-1285238870 None] Lock "cinder-9d99304e-465f-4bd8-bd73-b0ab57b6f91a-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:52 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.442s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03188673-4c96-468f-9f6a-1dcd9be780ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:30:52 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8906bc88-5373-4069-841a-dedb196f320a" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[41955758-d037-4b7d-893c-b36a469f2c72]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-quobyte-8906bc88-5373-4069-841a-dedb196f320a" released by "delete_volume" :: held 0.792s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:52 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Created reservations ['c8ca17c0-a9a3-4ae2-8b10-bb5fe0f2c07f', 'e15f51f4-815b-46b8-8072-76886af92666', '3d7bb129-0d8b-4300-b219-ba4249dff69a', '1f4b071c-db99-498b-8c3b-d00309a8b52d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:52 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:52 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:53 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:53 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:53 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.279s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:53 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Deleted volume successfully. Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fdc17945-4aed-4bbc-a51a-a82f4f955d02 tempest-VolumesTransfersV357Test-1879043366 None] Lock "cinder-8906bc88-5373-4069-841a-dedb196f320a-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:53 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.663s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:53 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:53 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:53 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.404s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:53 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793 Sep 22 18:30:53 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:54 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec.0d46d4a0-5e94-4d32-b03d-3469a80f3793" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-0d46d4a0-5e94-4d32-b03d-3469a80f3793" released by "_delete_snapshot" :: held 1.922s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" released by "delete_snapshot" :: held 1.967s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:54 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['e0f38e18-ecc8-4208-b33b-9a5a06800594', '83f1f7ee-493b-45ab-950a-9dd6e632134c', '2e81b3da-1d85-4027-9134-37fd3cc16e47', '0156e37a-0b50-4e26-bdbf-d95aa4a3c96e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Delete snapshot completed successfully. Sep 22 18:30:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5ec8c70f-976a-4676-a8c8-54a8d7f0e5c6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-0d46d4a0-5e94-4d32-b03d-3469a80f3793-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-03188673-4c96-468f-9f6a-1dcd9be780ec-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-03188673-4c96-468f-9f6a-1dcd9be780ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[850afb63-c43f-45da-89e9-fed92d9e7e5a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:55 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:55 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (264f5053-c49d-4058-8514-3cfafdf872bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cdbd49-4831-4a8f-9f03-2e1ed63e0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cdbd49-4831-4a8f-9f03-2e1ed63e0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791932298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c733de53-967e-4720-92a9-14f2d616b8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:56Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30c208-ac8f-448f-a6ac-f4fa3da4f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30c208-ac8f-448f-a6ac-f4fa3da4f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475363d2-02c9-4327-bd30-f7bf079efd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475363d2-02c9-4327-bd30-f7bf079efd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c733de53-967e-4720-92a9-14f2d616b8ba', 'volume_name': 'volume-c733de53-967e-4720-92a9-14f2d616b8ba', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151aaf9e-f779-4a6e-a4c9-7c4ab9f409f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151aaf9e-f779-4a6e-a4c9-7c4ab9f409f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b379352-8f92-4a8f-a2eb-6698f2ba032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume c733de53-967e-4720-92a9-14f2d616b8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c733de53-967e-4720-92a9-14f2d616b8ba', 'volume_size': 1} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791932298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c733de53-967e-4720-92a9-14f2d616b8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:56Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume c733de53-967e-4720-92a9-14f2d616b8ba {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:55 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:55 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba 1073741824 Sep 22 18:30:55 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:56 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.484s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:56 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec Sep 22 18:30:56 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:56 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-03188673-4c96-468f-9f6a-1dcd9be780ec" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:56 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba 1073741824" returned: 0 in 0.493s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-03188673-4c96-468f-9f6a-1dcd9be780ec" released by "delete_volume" :: held 0.858s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:56 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba Sep 22 18:30:56 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['ed27524c-44e1-476a-9f60-2cfc0fd6158c', '35ae2cc9-aa3c-42b8-b126-4b2e7e51123b', '7f161145-bdd1-4550-84de-eabebed84373', '10acbdb9-9e62-47ad-bd61-fed0d41c6d43'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:56 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:30:56 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:56 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b379352-8f92-4a8f-a2eb-6698f2ba032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c733de53-967e-4720-92a9-14f2d616b8ba', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f23ab3c-e0ff-46dd-a4bc-db951f0bac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-c733de53-967e-4720-92a9-14f2d616b8ba (c733de53-967e-4720-92a9-14f2d616b8ba): created successfully Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f23ab3c-e0ff-46dd-a4bc-db951f0bac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (264f5053-c49d-4058-8514-3cfafdf872bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5215aa18-2fcf-486c-a53c-11c341d1313c tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:30:56 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:30:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleted volume successfully. Sep 22 18:30:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3cce4d40-8314-4bd4-ae67-d1d388526c40 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-03188673-4c96-468f-9f6a-1dcd9be780ec-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (4bea83b8-e3de-4457-8e5c-e7d9652c6960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaba06c-3fe0-4e80-84ff-5e824dc9fbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaba06c-3fe0-4e80-84ff-5e824dc9fbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1859827475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707854a6-6107-451d-85ec-7a57aaba6097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:57Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19097696-945b-4b27-adac-a3b0f08b9310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19097696-945b-4b27-adac-a3b0f08b9310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86ae42-85bc-4fac-89ab-3825d7b42236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86ae42-85bc-4fac-89ab-3825d7b42236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707854a6-6107-451d-85ec-7a57aaba6097', 'volume_name': 'volume-707854a6-6107-451d-85ec-7a57aaba6097', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144fec9-05ea-4f3b-99d7-0fdff012444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144fec9-05ea-4f3b-99d7-0fdff012444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91ff10f-5430-4c75-9ba6-fe04af8ff790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume 707854a6-6107-451d-85ec-7a57aaba6097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707854a6-6107-451d-85ec-7a57aaba6097', 'volume_size': 1} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1859827475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707854a6-6107-451d-85ec-7a57aaba6097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:57Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating volume 707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:57 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 1073741824 Sep 22 18:30:57 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:57 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 1073741824" returned: 0 in 0.470s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:57 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:30:57 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:58 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.272s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91ff10f-5430-4c75-9ba6-fe04af8ff790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707854a6-6107-451d-85ec-7a57aaba6097', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fe5a6f-995d-4f9c-905b-25520605d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume volume-707854a6-6107-451d-85ec-7a57aaba6097 (707854a6-6107-451d-85ec-7a57aaba6097): created successfully Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fe5a6f-995d-4f9c-905b-25520605d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (4bea83b8-e3de-4457-8e5c-e7d9652c6960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-abf5f2b3-e26c-4d67-938a-95c353ae1ca8 tempest-VolumesSnapshotTestJSON-1152660831 None] Created volume successfully. Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (831ee3cc-60bd-43a4-b248-f15de62570db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd9ebd2-92f4-40b3-aaf4-297c59cc65cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd9ebd2-92f4-40b3-aaf4-297c59cc65cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1065383744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e87fdb-eb51-41f1-a284-7ca6a9462c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:58Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b08440-e029-4f52-a306-46605b759a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b08440-e029-4f52-a306-46605b759a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13a3f96-cb18-4a15-9a56-45c209d08489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13a3f96-cb18-4a15-9a56-45c209d08489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e87fdb-eb51-41f1-a284-7ca6a9462c24', 'volume_name': 'volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a52603-3d25-423d-b00e-ae9cd2d9aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a52603-3d25-423d-b00e-ae9cd2d9aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5550e642-f367-4aa6-a7fe-648ae328fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume e2e87fdb-eb51-41f1-a284-7ca6a9462c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24', 'volume_size': 1} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1065383744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e87fdb-eb51-41f1-a284-7ca6a9462c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:58Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume e2e87fdb-eb51-41f1-a284-7ca6a9462c24 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:30:58 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:58 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 1073741824 Sep 22 18:30:58 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (14ccf66d-4fab-4908-9cea-8edddd846c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9f135-cec7-448f-8a5a-141c8c019f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9f135-cec7-448f-8a5a-141c8c019f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-776174929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:59Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f526d6b-b803-4f9a-adf0-24c376d1b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f526d6b-b803-4f9a-adf0-24c376d1b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e569b-5b93-4ede-8e14-c60fbcfd6daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e569b-5b93-4ede-8e14-c60fbcfd6daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb', 'volume_name': 'volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1ac186-1a22-4220-a234-081ff8578e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1ac186-1a22-4220-a234-081ff8578e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95ae112-741f-4d44-b4dc-f1a5ab5d3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume 0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb', 'volume_size': 1} Sep 22 18:30:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:59 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 1073741824" returned: 0 in 0.580s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:59 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 Sep 22 18:30:59 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (fde1b483-2c90-448d-9c60-37ac3165005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669361c8-f383-4556-9237-69e80c45cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669361c8-f383-4556-9237-69e80c45cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1690730722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef31bc9a-4565-4a1f-a8c7-4f33080f42da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:59Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f07197-4ade-48cc-9744-53bb7a66bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f07197-4ade-48cc-9744-53bb7a66bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033ce00-4f69-4959-8b5f-5a1990534ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033ce00-4f69-4959-8b5f-5a1990534ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef31bc9a-4565-4a1f-a8c7-4f33080f42da', 'volume_name': 'volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37a4873-127c-4b8c-9312-baa92d8505c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37a4873-127c-4b8c-9312-baa92d8505c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deed5317-f3a5-4627-b2c2-180a128fba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume ef31bc9a-4565-4a1f-a8c7-4f33080f42da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da', 'volume_size': 1} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:30:59 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" returned: 0 in 0.343s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.916s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5550e642-f367-4aa6-a7fe-648ae328fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99e8882-f4fd-4c87-b75e-880eddc4cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating offline snapshot 4b9cde89-c283-483b-a6c5-c130e0a76b45 of volume 707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:30:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 (e2e87fdb-eb51-41f1-a284-7ca6a9462c24): created successfully Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99e8882-f4fd-4c87-b75e-880eddc4cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (831ee3cc-60bd-43a4-b248-f15de62570db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cfd861-4820-4948-97a0-d56f2a0253e2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:30:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6eb11bc9-7a24-4eaf-980b-0e80a1bf0eb6 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (5b32fd0b-9d2f-429f-9050-705e8483b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e86741-dca7-4b5a-8f34-1bcbefde1a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e86741-dca7-4b5a-8f34-1bcbefde1a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781104313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b8256d-f08d-4202-a5a5-184af31c6ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:30:59 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd7336b-a2a0-42d8-87ef-b530a8ec90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd7336b-a2a0-42d8-87ef-b530a8ec90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b19bd4a-d166-4aa3-8971-a81194786629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b19bd4a-d166-4aa3-8971-a81194786629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b8256d-f08d-4202-a5a5-184af31c6ad1', 'volume_name': 'volume-49b8256d-f08d-4202-a5a5-184af31c6ad1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f210d69-0426-4f4a-88ce-fa9ca5f7f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f210d69-0426-4f4a-88ce-fa9ca5f7f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205c8cc-afac-4fa2-b6ad-843529c76cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:30:59 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume 49b8256d-f08d-4202-a5a5-184af31c6ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b8256d-f08d-4202-a5a5-184af31c6ad1', 'volume_size': 1} Sep 22 18:30:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:00 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.534s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:00 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 1G Sep 22 18:31:00 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (1223da41-7a3a-49b1-9619-5620648369c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5f8a7f-3935-4242-bb66-835cdc970a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5f8a7f-3935-4242-bb66-835cdc970a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975988309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c318583-2b19-40ad-9622-a413acc937af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba12277d-6cb4-49c4-9378-de0bc0b155b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba12277d-6cb4-49c4-9378-de0bc0b155b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa05f34-c70c-4739-a185-ff86080e0e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa05f34-c70c-4739-a185-ff86080e0e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c318583-2b19-40ad-9622-a413acc937af', 'volume_name': 'volume-3c318583-2b19-40ad-9622-a413acc937af', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0373ce56-c8ef-4bf9-890a-e41b07c80669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0373ce56-c8ef-4bf9-890a-e41b07c80669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc8fc11-15b8-497e-9b20-4df9b3d1f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume 3c318583-2b19-40ad-9622-a413acc937af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c318583-2b19-40ad-9622-a413acc937af', 'volume_size': 1} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Flow 'volume_create_manager' (71799486-e405-490b-9493-50dd29bc9817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f289bfb-40db-49f6-a73d-2837f5276e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f289bfb-40db-49f6-a73d-2837f5276e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-352360720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2934052-1498-415d-a619-0935f8d74829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc62eb0524f4104bf29823192ebb898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='471b9f9c7cdf4787aa1cd8ce12b23682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591bafc-d7e3-459c-ac64-a390c429d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591bafc-d7e3-459c-ac64-a390c429d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a471a3-99ae-4e5a-a22d-20fdf3097773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a471a3-99ae-4e5a-a22d-20fdf3097773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2934052-1498-415d-a619-0935f8d74829', 'volume_name': 'volume-d2934052-1498-415d-a619-0935f8d74829', 'volume_size': 2}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd61810-fe55-468b-a5d0-3c3bc707cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd61810-fe55-468b-a5d0-3c3bc707cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecf87fa-0caa-4d9e-bb56-dc38b5bc2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:00 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Volume d2934052-1498-415d-a619-0935f8d74829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2934052-1498-415d-a619-0935f8d74829', 'volume_size': 2} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 1G" returned: 0 in 0.422s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707854a6-6107-451d-85ec-7a57aaba6097 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:00 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707854a6-6107-451d-85ec-7a57aaba6097 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:00 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:00 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707854a6-6107-451d-85ec-7a57aaba6097 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.307s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:00 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 is being set with open permissions: ugo+rw Sep 22 18:31:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:00 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:00 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:01 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:01 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info Sep 22 18:31:01 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:01 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:01 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info is being set with open permissions: ugo+rw Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:01 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info Sep 22 18:31:01 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:01 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.info" returned: 0 in 0.230s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-776174929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:59Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume 0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:01 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:01 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb 1073741824 Sep 22 18:31:01 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1966e348-11d6-4de1-958d-94f321db60a3 tempest-VolumesSnapshotTestJSON-1152660831 None] Create snapshot completed successfully Sep 22 18:31:02 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb 1073741824" returned: 0 in 0.395s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:02 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb Sep 22 18:31:02 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:02 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1690730722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef31bc9a-4565-4a1f-a8c7-4f33080f42da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:30:59Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume ef31bc9a-4565-4a1f-a8c7-4f33080f42da {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:02 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95ae112-741f-4d44-b4dc-f1a5ab5d3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd744e06-051b-43e8-8b2c-f5e9d30c5586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:02 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da 1073741824 Sep 22 18:31:02 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb (0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb): created successfully Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd744e06-051b-43e8-8b2c-f5e9d30c5586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (14ccf66d-4fab-4908-9cea-8edddd846c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6084303d-31e0-4218-a949-e2ed82651073 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:31:02 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da 1073741824" returned: 0 in 0.414s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=158,cinder:INSERT=54,cinder:UPDATE=208,cinder:DELETE=20 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:31:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:02 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da Sep 22 18:31:02 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:03 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.289s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781104313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b8256d-f08d-4202-a5a5-184af31c6ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume 49b8256d-f08d-4202-a5a5-184af31c6ad1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deed5317-f3a5-4627-b2c2-180a128fba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 1073741824 Sep 22 18:31:03 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7d423-4810-41c1-8986-186aec5a892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da (ef31bc9a-4565-4a1f-a8c7-4f33080f42da): created successfully Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7d423-4810-41c1-8986-186aec5a892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (fde1b483-2c90-448d-9c60-37ac3165005a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-574e4c4e-ec76-47c7-8962-570f131db3fd tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (da67a292-4911-4538-a9e2-cd21473b02f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c5fa72-8404-4884-a339-38d20952f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c5fa72-8404-4884-a339-38d20952f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1184037926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8fb457-1707-4fe5-bece-84b940a6d2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5408fb18004ecb8d1462805099b18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b9cde89-c283-483b-a6c5-c130e0a76b45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:03Z,use_quota=True,user_id='fa3757d6bcfd46ff9e716c31efd12ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4179f43-2328-4bb2-8bc2-de2b6248baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4179f43-2328-4bb2-8bc2-de2b6248baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a99242c-8d22-4f6e-afd6-a0229bf0eb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a99242c-8d22-4f6e-afd6-a0229bf0eb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c8fb457-1707-4fe5-bece-84b940a6d2fe', 'volume_name': 'volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe', 'volume_size': 1, 'snapshot_id': '4b9cde89-c283-483b-a6c5-c130e0a76b45'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed123b12-d0ec-4e60-a4cc-87d49f54954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed123b12-d0ec-4e60-a4cc-87d49f54954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cacb3d-5b1a-49ed-94ff-e90fa1ae1514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume 7c8fb457-1707-4fe5-bece-84b940a6d2fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe', 'volume_size': 1, 'snapshot_id': '4b9cde89-c283-483b-a6c5-c130e0a76b45'} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:03 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 1073741824" returned: 0 in 0.473s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:03 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 Sep 22 18:31:03 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:03 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.590s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975988309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c318583-2b19-40ad-9622-a413acc937af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22f14db54b144ac831b38ca4f8243ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='58b7a504fa1e4ad9a4226f51903f16ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Creating volume 3c318583-2b19-40ad-9622-a413acc937af {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205c8cc-afac-4fa2-b6ad-843529c76cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b8256d-f08d-4202-a5a5-184af31c6ad1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af 1073741824 Sep 22 18:31:03 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f083b31b-6d3e-478b-bf46-d50b89eaff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 (49b8256d-f08d-4202-a5a5-184af31c6ad1): created successfully Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f083b31b-6d3e-478b-bf46-d50b89eaff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (5b32fd0b-9d2f-429f-9050-705e8483b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a65d0b97-2803-4a93-91ae-d8211db3ef18 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:31:04 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af 1073741824" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:04 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af Sep 22 18:31:04 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:04 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.972s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-352360720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2934052-1498-415d-a619-0935f8d74829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc62eb0524f4104bf29823192ebb898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:00Z,use_quota=True,user_id='471b9f9c7cdf4787aa1cd8ce12b23682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Creating volume d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:04 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 2147483648 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:04 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 2147483648 Sep 22 18:31:04 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc8fc11-15b8-497e-9b20-4df9b3d1f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c318583-2b19-40ad-9622-a413acc937af', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5b995f-ec7e-4e0e-ab27-6aed521a09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:04 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Volume volume-3c318583-2b19-40ad-9622-a413acc937af (3c318583-2b19-40ad-9622-a413acc937af): created successfully Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5b995f-ec7e-4e0e-ab27-6aed521a09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Flow 'volume_create_manager' (1223da41-7a3a-49b1-9619-5620648369c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b19e4f43-79a6-4d87-b471-b5bece8b0eae tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created volume successfully. Sep 22 18:31:04 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 2147483648" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:05 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 Sep 22 18:31:05 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:05 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829" returned: 0 in 0.228s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.716s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45-7c8fb457-1707-4fe5-bece-84b940a6d2fe" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecf87fa-0caa-4d9e-bb56-dc38b5bc2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2934052-1498-415d-a619-0935f8d74829', 'volume_size': 2}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e8263c-f98f-42d3-944b-3b888ab78e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45-7c8fb457-1707-4fe5-bece-84b940a6d2fe" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating volume 7c8fb457-1707-4fe5-bece-84b940a6d2fe from snapshot 4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Volume volume-d2934052-1498-415d-a619-0935f8d74829 (d2934052-1498-415d-a619-0935f8d74829): created successfully Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e8263c-f98f-42d3-944b-3b888ab78e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Flow 'volume_create_manager' (71799486-e405-490b-9493-50dd29bc9817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] snapshot: 4b9cde89-c283-483b-a6c5-c130e0a76b45, volume: 7c8fb457-1707-4fe5-bece-84b940a6d2fe, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:31:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-29ea3391-35d6-4e1c-b962-4e1db96fd8a9 tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Created volume successfully. Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b4af8-59cf-41ef-aaad-aaaac623c8da]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:05 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:05 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-3c318583-2b19-40ad-9622-a413acc937af-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-3c318583-2b19-40ad-9622-a413acc937af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-3c318583-2b19-40ad-9622-a413acc937af" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-3c318583-2b19-40ad-9622-a413acc937af" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:05 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.398s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707854a6-6107-451d-85ec-7a57aaba6097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04c1af-8f35-4d53-a74f-c9e3ae45f9c9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[640dd279-295e-4a99-9ae8-cdd7b54a9b47]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:05 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af Sep 22 18:31:05 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:05 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:31:05 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:06 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:06 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.390s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:06 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af Sep 22 18:31:06 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:06 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe Sep 22 18:31:06 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:06 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3c318583-2b19-40ad-9622-a413acc937af" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-3c318583-2b19-40ad-9622-a413acc937af" released by "delete_volume" :: held 0.685s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['1b54542d-9fbf-474e-bce0-8ffef55697b9', '607ccce3-ddcd-4b99-895d-3553ed91ebe7', '9ebdfc1c-65f6-4313-a991-79e89993db78', 'c8275095-cc50-457e-9413-5334fa954c47'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:06 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:06 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:06 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-49b8256d-f08d-4202-a5a5-184af31c6ad1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-49b8256d-f08d-4202-a5a5-184af31c6ad1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-18f88611-3cf4-466d-bfad-9d42b5084943 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-3c318583-2b19-40ad-9622-a413acc937af-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-49b8256d-f08d-4202-a5a5-184af31c6ad1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-49b8256d-f08d-4202-a5a5-184af31c6ad1" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[310893d8-ded8-46fd-9484-811af05b6245]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:07 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 Sep 22 18:31:07 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:07 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1" returned: 0 in 0.656s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:07 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1 Sep 22 18:31:07 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:08 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-49b8256d-f08d-4202-a5a5-184af31c6ad1" returned: 0 in 0.334s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-49b8256d-f08d-4202-a5a5-184af31c6ad1" released by "delete_volume" :: held 1.075s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=204,cinder:DELETE=21,cinder:SELECT=173,cinder:INSERT=54 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['e55ee0f5-af99-44ac-b2e9-03e8a58cc314', '818afd61-3ec2-4274-931d-1a73ff545793', '795c71d3-5fba-4dae-bfd9-5fc42f2d8b8e', 'cde8dead-ea52-4ce7-81e0-69a447ed3653'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:08 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:08 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:08 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.371s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-98cc9502-b860-4b0d-927d-51a3df27a6da tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-49b8256d-f08d-4202-a5a5-184af31c6ad1-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-ef31bc9a-4565-4a1f-a8c7-4f33080f42da-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-ef31bc9a-4565-4a1f-a8c7-4f33080f42da-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b3db4c-0a3c-4f71-a9f0-4019dd3b7fa5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:09 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da Sep 22 18:31:09 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:10 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" returned: 0 in 0.719s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:10 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da Sep 22 18:31:10 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:10 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-ef31bc9a-4565-4a1f-a8c7-4f33080f42da" released by "delete_volume" :: held 1.160s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['cc35b861-0426-4def-b739-73f0a2d41edf', 'cf2ebb7a-ea9a-4b3e-835b-7d024c5fea2c', 'ef33be79-61ff-4f25-b263-a1123e2837c3', 'ccb483fc-3059-444b-9b2f-0827faf53467'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:10 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:10 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:11 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.487s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7cb5cbbd-7573-4200-b8f4-58e6ece3ee99 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-ef31bc9a-4565-4a1f-a8c7-4f33080f42da-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" acquired by "delete_volume" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ccb94d-e7fd-40d5-a51b-b219f3780fb8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:11 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb Sep 22 18:31:11 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:12 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" returned: 0 in 0.496s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:12 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb Sep 22 18:31:12 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:12 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb" released by "delete_volume" :: held 0.871s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:12 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe" returned: 0 in 6.479s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:31:12 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Converted 1024.00 MB image at 158.02 MB/s Sep 22 18:31:12 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe is being set with open permissions: ugo+rw Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:12 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe Sep 22 18:31:12 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['e0525441-2244-43f9-82e3-5d354235fadb', '1b17510e-0f71-4690-b868-ef847537acf4', 'c82d3872-e1e5-4c63-ab55-7e9d92edb9a1', 'b90b118a-e593-49fe-8e19-e7bac71e26e8'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:12 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:12 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-e2e87fdb-eb51-41f1-a284-7ca6a9462c24-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-e2e87fdb-eb51-41f1-a284-7ca6a9462c24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:12 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" released by "_copy_volume_from_snapshot" :: held 7.635s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acf829c-80b9-4c95-9298-e9e099cac048]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45-7c8fb457-1707-4fe5-bece-84b940a6d2fe" released by "_create_volume_from_snapshot" :: held 7.741s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.774s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.042s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:13 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Creating offline snapshot bdd323b8-b978-4377-bb1b-1b5695a266e8 of volume d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cacb3d-5b1a-49ed-94ff-e90fa1ae1514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe', 'volume_size': 1, 'snapshot_id': '4b9cde89-c283-483b-a6c5-c130e0a76b45'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f00161-7963-4cd2-b0da-0ab75709618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2242b-4376-4dfb-9966-626ef3112057]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Volume volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe (7c8fb457-1707-4fe5-bece-84b940a6d2fe): created successfully Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f00161-7963-4cd2-b0da-0ab75709618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Flow 'volume_create_manager' (da67a292-4911-4538-a9e2-cd21473b02f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:13 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cd6949c2-dc70-4e39-a6fb-ccea7e6f1618 tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-0e5ae294-b48e-48f7-9f6b-e1e6cc4d98fb-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:13 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e6bf5c0e-0248-4bc7-abed-87535a7a10d6 tempest-VolumesSnapshotTestJSON-1152660831 None] Created volume successfully. Sep 22 18:31:13 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 Sep 22 18:31:13 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:13 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24 Sep 22 18:31:13 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:13 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829" returned: 0 in 0.372s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 2G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 2G Sep 22 18:31:13 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:13 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" returned: 0 in 0.235s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-e2e87fdb-eb51-41f1-a284-7ca6a9462c24" released by "delete_volume" :: held 0.663s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['fd9667b7-b6d6-4de3-ad6b-442007127848', '4e5f2fe0-bbdf-48c0-bbe6-4b791354830e', '548ecf06-876a-458c-b31f-d18c05bdef41', '16877185-e140-459c-8f51-bacc28ea9a2b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:13 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:13 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 2G" returned: 0 in 0.408s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2934052-1498-415d-a619-0935f8d74829 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:13 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2934052-1498-415d-a619-0935f8d74829 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 Sep 22 18:31:13 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ccd1e16e-4fed-4203-8008-2260d7e18f9b tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-e2e87fdb-eb51-41f1-a284-7ca6a9462c24-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-c733de53-967e-4720-92a9-14f2d616b8ba-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-c733de53-967e-4720-92a9-14f2d616b8ba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "cinder-quobyte-c733de53-967e-4720-92a9-14f2d616b8ba" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-c733de53-967e-4720-92a9-14f2d616b8ba" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[942bfc29-0567-4d6a-96d3-603f68207731]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2934052-1498-415d-a619-0935f8d74829 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8" returned: 0 in 0.309s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 is being set with open permissions: ugo+rw Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 Sep 22 18:31:14 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba Sep 22 18:31:14 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-7c8fb457-1707-4fe5-bece-84b940a6d2fe-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-7c8fb457-1707-4fe5-bece-84b940a6d2fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17cb8a-0b3f-4064-924c-7a60da5e0737]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8" returned: 0 in 0.280s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info Sep 22 18:31:14 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe Sep 22 18:31:14 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba" returned: 0 in 0.416s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba Sep 22 18:31:14 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info is being set with open permissions: ugo+rw Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info Sep 22 18:31:14 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:14 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:14 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe Sep 22 18:31:14 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c733de53-967e-4720-92a9-14f2d616b8ba" returned: 0 in 0.257s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-quobyte-c733de53-967e-4720-92a9-14f2d616b8ba" released by "delete_volume" :: held 0.725s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Created reservations ['9257c8d7-9f96-47ad-9599-9f64fb93b16f', '8bc04c2c-87dd-4770-aad1-5c4f430f0987', '717e0b52-ece4-4f0a-8760-60c891d75253', 'cce64c2b-8f61-4585-94df-1858da2208fb'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:15 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:15 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:15 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.info" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:15 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7c8fb457-1707-4fe5-bece-84b940a6d2fe" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-07d40ed9-3969-496d-b41d-f09fbeb25a1b tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Create snapshot completed successfully Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-7c8fb457-1707-4fe5-bece-84b940a6d2fe" released by "delete_volume" :: held 0.668s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['f1520bdf-99ba-4432-a428-9228e79a0753', '2617038c-e992-4548-a94e-b2456ed59823', '98e923f3-f6d7-4101-9d0a-d8dc85c84e09', '31966f1e-8752-4b83-8f54-2681266cb2b0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:15 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:15 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:15 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.255s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Deleted volume successfully. Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ac67f6bb-e010-48b2-a1ca-574dee91cbdc tempest-CreateVolumesFromSourceVolumeTest-66067623 None] Lock "cinder-c733de53-967e-4720-92a9-14f2d616b8ba-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:15 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.289s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleted volume successfully. Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10582a30-e2c2-497c-82f6-f70a9503edd0 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-7c8fb457-1707-4fe5-bece-84b940a6d2fe-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-4b9cde89-c283-483b-a6c5-c130e0a76b45-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "cinder-bdd323b8-b978-4377-bb1b-1b5695a266e8-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-4b9cde89-c283-483b-a6c5-c130e0a76b45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-bdd323b8-b978-4377-bb1b-1b5695a266e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "cinder-quobyte-bdd323b8-b978-4377-bb1b-1b5695a266e8" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleting offline snapshot 4b9cde89-c283-483b-a6c5-c130e0a76b45 of volume 707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] snapshot_file for this snap is: volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-bdd323b8-b978-4377-bb1b-1b5695a266e8" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Deleting offline snapshot bdd323b8-b978-4377-bb1b-1b5695a266e8 of volume d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] snapshot_file for this snap is: volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572de3f-a158-4183-ac33-69a6ce5fe7bb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc993280-585c-49b4-a8a6-e52454888258]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:15 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 Sep 22 18:31:15 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:15 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:15 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:16 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8" returned: 0 in 0.396s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2934052-1498-415d-a619-0935f8d74829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:16 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707854a6-6107-451d-85ec-7a57aaba6097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[490abe31-de00-4560-841a-bcd3ea4cd090]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fffb7b-9ebc-4847-a20e-0b409bc4cd49]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:16 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 Sep 22 18:31:16 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:16 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:31:16 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:16 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:16 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 Sep 22 18:31:16 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:16 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.574s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:16 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:16 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:17 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8" returned: 0 in 0.414s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:17 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8 Sep 22 18:31:17 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:17 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.375s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:17 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45 Sep 22 18:31:17 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:17 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829.bdd323b8-b978-4377-bb1b-1b5695a266e8" returned: 0 in 0.271s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-bdd323b8-b978-4377-bb1b-1b5695a266e8" released by "_delete_snapshot" :: held 1.614s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" released by "delete_snapshot" :: held 1.671s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Created reservations ['a7acd3d3-7d36-4055-a50a-544325a50f28', '7917b5b3-9fff-49b3-9690-5f611d8cbfbd', '0a6c4734-68b7-4fda-9893-8a1173671f1e', '6a07d411-bae0-4ac3-8007-90da7b974110'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:17 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097.4b9cde89-c283-483b-a6c5-c130e0a76b45" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-4b9cde89-c283-483b-a6c5-c130e0a76b45" released by "_delete_snapshot" :: held 1.816s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" released by "delete_snapshot" :: held 1.851s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Delete snapshot completed successfully. Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-32b8c7cb-34bb-4661-aa92-ba8e8852e7aa tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-bdd323b8-b978-4377-bb1b-1b5695a266e8-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['9b4c24ca-53b6-40c9-a8c7-47a811f8e545', '8848cc5f-6007-4920-a13b-b3790cbc4251', 'c9fb5d1b-4b64-40e5-bae3-dead9c70768f', '45cd11fa-eaf7-47e3-8e21-050fa8bc3c00'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Delete snapshot completed successfully. Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d6942e03-7446-49dc-8152-4bd402061353 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-4b9cde89-c283-483b-a6c5-c130e0a76b45-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-707854a6-6107-451d-85ec-7a57aaba6097-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-707854a6-6107-451d-85ec-7a57aaba6097-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "cinder-d2934052-1498-415d-a619-0935f8d74829-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-d2934052-1498-415d-a619-0935f8d74829-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa0333-4d94-4283-87e7-a389636a8a69]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d71b66-d7bd-47c8-848a-624974e692c8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:31:18 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:18 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 Sep 22 18:31:18 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:18 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.408s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097 Sep 22 18:31:18 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:18 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829" returned: 0 in 0.417s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829 Sep 22 18:31:18 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:18 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-707854a6-6107-451d-85ec-7a57aaba6097" returned: 0 in 0.280s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-707854a6-6107-451d-85ec-7a57aaba6097" released by "delete_volume" :: held 0.769s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:18 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d2934052-1498-415d-a619-0935f8d74829" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-quobyte-d2934052-1498-415d-a619-0935f8d74829" released by "delete_volume" :: held 0.769s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['177704cd-6abc-45ab-814f-5bae5d9679e9', '0ec6914f-d474-45c2-9644-ae7bccbcded8', '936429e9-0ce4-412f-b8df-114730834431', '0c71a515-aa03-456c-8b51-c7bc376336f6'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Created reservations ['df28cefb-fce2-4b0b-ae76-2d605682c509', '50b4c831-f0ef-46f6-8cce-921d098b63bb', '8564dc5f-2bb5-42d9-b150-8c5b946473bf', '85c86d0e-26e5-4e92-8cd7-722c4bba9500'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:18 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:18 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:18 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-91d96ebd-6046-4295-9881-45000de3cee0-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-91d96ebd-6046-4295-9881-45000de3cee0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:19 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:19 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.456s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Deleted volume successfully. Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ace68-d259-4f9c-bccc-ff3ef54349a3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleted volume successfully. Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e1d6f09e-0079-47e9-8b19-e69f65e7b9cc tempest-VolumesSnapshotNegativeTestJSON-1845285329 None] Lock "cinder-d2934052-1498-415d-a619-0935f8d74829-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d80e53b8-4d9d-45c8-923f-6bb2b9dccac6 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-707854a6-6107-451d-85ec-7a57aaba6097-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:19 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 Sep 22 18:31:19 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:19 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0" returned: 0 in 0.406s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:19 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0 Sep 22 18:31:19 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:20 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91d96ebd-6046-4295-9881-45000de3cee0" returned: 0 in 0.273s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-quobyte-91d96ebd-6046-4295-9881-45000de3cee0" released by "delete_volume" :: held 0.789s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Created reservations ['f343092d-13ec-4440-9b41-136d3ef21ad8', 'd5e21791-d989-466a-a420-aed0f6bef14c', '7755155e-386e-4a07-a16b-5aaeacc30a2c', '62554e4b-0db9-4624-adc2-4b1a36939596'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:20 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:20 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:20 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Deleted volume successfully. Sep 22 18:31:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c6879741-6a5f-4cc5-8504-97ab64fd6ec3 tempest-VolumesSnapshotTestJSON-1152660831 None] Lock "cinder-91d96ebd-6046-4295-9881-45000de3cee0-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Flow 'volume_create_manager' (2383db2e-5072-4b73-9de7-63284e54b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7864bf61-6622-40be-9d8f-033ff707f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7864bf61-6622-40be-9d8f-033ff707f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1674302351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babcd84-6c7a-4872-bde7-e0ec0ca11019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefc284356d445868f30e300755c7aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:29Z,use_quota=True,user_id='d36281cb4dce4904907f50f341a28969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154748f6-6cfa-46d7-b242-5a82a7d3fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154748f6-6cfa-46d7-b242-5a82a7d3fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a440ffac-4ce0-4789-9166-d9069fcefcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a440ffac-4ce0-4789-9166-d9069fcefcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3babcd84-6c7a-4872-bde7-e0ec0ca11019', 'volume_name': 'volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1a4a92-6e85-4266-ae31-bcbfa2138ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1a4a92-6e85-4266-ae31-bcbfa2138ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ad2f6f-4c77-43fe-9eb9-69dfe9adc8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019', 'volume_size': 1} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1674302351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babcd84-6c7a-4872-bde7-e0ec0ca11019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefc284356d445868f30e300755c7aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:29Z,use_quota=True,user_id='d36281cb4dce4904907f50f341a28969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Creating volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:28 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:29 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 1073741824 Sep 22 18:31:29 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:29 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 1073741824" returned: 0 in 0.430s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:29 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 Sep 22 18:31:29 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:29 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ad2f6f-4c77-43fe-9eb9-69dfe9adc8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32210b41-0fda-43d5-83f2-80170e725a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:29 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Volume volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 (3babcd84-6c7a-4872-bde7-e0ec0ca11019): created successfully Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32210b41-0fda-43d5-83f2-80170e725a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Flow 'volume_create_manager' (2383db2e-5072-4b73-9de7-63284e54b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9bc2d3c8-5f77-4f8b-8a01-2fba3c7ae168 tempest-VolumesSnapshotListTestJSON-1834986612 None] Created volume successfully. Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Creating offline snapshot 64f4c7bf-bd39-4f63-abda-cc035fc5d11d of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb455ef-8090-423c-94e2-3e5f7d7ac2a8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:30 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 Sep 22 18:31:30 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:30 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:30 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d 1G Sep 22 18:31:30 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:30 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d 1G" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:30 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:30 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:31 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d is being set with open permissions: ugo+rw Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:31 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:31 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:31 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.235s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:31 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info Sep 22 18:31:31 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:31 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info" returned: 0 in 0.251s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info is being set with open permissions: ugo+rw Sep 22 18:31:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:31 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info Sep 22 18:31:31 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:32 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.info" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8602ccd4-6b22-4b63-8a72-f589362eff67 tempest-VolumesSnapshotListTestJSON-1834986612 None] Create snapshot completed successfully Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Creating offline snapshot f4237fb0-be97-44a1-8e87-028053c6863f of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df67877-a272-4a4f-b62a-60064cfbdbcf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:32 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:32 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:32 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:32 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f 1G Sep 22 18:31:32 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:33 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f 1G" returned: 0 in 0.476s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:33 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:33 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:33 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:33 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f is being set with open permissions: ugo+rw Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:33 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:33 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:33 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.551s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a3875492-062a-4621-89a2-8e8354ab75f6 tempest-VolumesSnapshotListTestJSON-1834986612 None] Create snapshot completed successfully Sep 22 18:31:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Creating offline snapshot de09df91-2edd-4cfc-ae45-d635fe63a06c of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:31:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bfb8f-9896-4583-b1db-6bb7cc5b8c1c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:34 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:34 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:35 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:35 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c 1G Sep 22 18:31:35 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:35 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c 1G" returned: 0 in 0.495s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:35 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c Sep 22 18:31:35 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:35 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c" returned: 0 in 0.330s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:35 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c is being set with open permissions: ugo+rw Sep 22 18:31:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:35 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c Sep 22 18:31:35 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:36 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.556s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3ac4a9af-e192-4339-9ccb-85ab9222cb68 tempest-VolumesSnapshotListTestJSON-1834986612 None] Create snapshot completed successfully Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-de09df91-2edd-4cfc-ae45-d635fe63a06c-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-de09df91-2edd-4cfc-ae45-d635fe63a06c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-de09df91-2edd-4cfc-ae45-d635fe63a06c" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-de09df91-2edd-4cfc-ae45-d635fe63a06c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Deleting offline snapshot de09df91-2edd-4cfc-ae45-d635fe63a06c of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] snapshot_file for this snap is: volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f23e18-76a6-4c32-b879-5444121b74bb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:38 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c Sep 22 18:31:38 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:38 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8467fe74-56bc-49f0-8ebc-479cc5a46b9a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:38 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:38 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:38 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.386s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:38 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c Sep 22 18:31:38 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:39 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c" returned: 0 in 0.429s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:39 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c Sep 22 18:31:39 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:39 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.de09df91-2edd-4cfc-ae45-d635fe63a06c" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-de09df91-2edd-4cfc-ae45-d635fe63a06c" released by "_delete_snapshot" :: held 1.578s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" released by "delete_snapshot" :: held 1.602s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Created reservations ['38f240c9-a186-4503-85b5-7dbf55b7d553', '6dfa8c6c-78a2-42a1-a7e2-b5abc040cc4b', '854d144d-5cd3-48fe-b691-62844f9c61dd', '46d2d9bd-3b42-47ac-8ddf-8879fe3a4dc8'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Delete snapshot completed successfully. Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b2418af2-4729-4242-b964-a1250a1dfddc tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-de09df91-2edd-4cfc-ae45-d635fe63a06c-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-f4237fb0-be97-44a1-8e87-028053c6863f-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-f4237fb0-be97-44a1-8e87-028053c6863f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-f4237fb0-be97-44a1-8e87-028053c6863f" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-f4237fb0-be97-44a1-8e87-028053c6863f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Deleting offline snapshot f4237fb0-be97-44a1-8e87-028053c6863f of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] snapshot_file for this snap is: volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a317c5cd-d566-457e-a5f8-b2a7e0533439]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:40 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:40 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:40 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.409s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae5f90-195c-457d-bb4d-bfd8f4309cb5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:40 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:40 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:40 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:41 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:41 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:41 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.457s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:41 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f Sep 22 18:31:41 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:41 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.f4237fb0-be97-44a1-8e87-028053c6863f" returned: 0 in 0.275s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-f4237fb0-be97-44a1-8e87-028053c6863f" released by "_delete_snapshot" :: held 1.735s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" released by "delete_snapshot" :: held 1.764s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Created reservations ['67981265-aed8-4f20-aa2b-a348e95b64b5', '214cad75-49bc-491c-b214-50380c428a1c', '4be4d4a2-a009-43d1-a181-af96e800d56e', 'c6e11cdf-1da8-4216-9878-94cb5ad13667'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Delete snapshot completed successfully. Sep 22 18:31:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-de6641fb-a6b5-4f19-aafd-60a8955afec9 tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-f4237fb0-be97-44a1-8e87-028053c6863f-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-64f4c7bf-bd39-4f63-abda-cc035fc5d11d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-64f4c7bf-bd39-4f63-abda-cc035fc5d11d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-64f4c7bf-bd39-4f63-abda-cc035fc5d11d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-64f4c7bf-bd39-4f63-abda-cc035fc5d11d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Deleting offline snapshot 64f4c7bf-bd39-4f63-abda-cc035fc5d11d of volume 3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] snapshot_file for this snap is: volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[68844d07-85b0-492e-9ce0-3491788086c8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:42 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:42 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:42 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbbc3c9-ee90-4a39-a78e-eece722180f7]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:42 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 Sep 22 18:31:42 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:43 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019" returned: 0 in 0.428s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:43 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:43 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:43 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:43 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d Sep 22 18:31:43 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:43 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019.64f4c7bf-bd39-4f63-abda-cc035fc5d11d" returned: 0 in 0.280s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-64f4c7bf-bd39-4f63-abda-cc035fc5d11d" released by "_delete_snapshot" :: held 1.553s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" released by "delete_snapshot" :: held 1.576s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Created reservations ['42affdf7-6029-4434-808b-432db7726765', '272659bf-9a1e-4730-b428-9ff1d0e82412', '2ec80635-ef6b-47c5-842b-8a9e667a4efc', '47938fa8-b0ca-4741-8d72-58297e76e1d9'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Delete snapshot completed successfully. Sep 22 18:31:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-29f4d079-107f-425f-b2a0-bcb8d8130ecd tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-64f4c7bf-bd39-4f63-abda-cc035fc5d11d-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Flow 'volume_create_manager' (2d530a5f-9516-4e9e-b9be-a8b7b186bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbc45aa-0a16-4ea8-a42a-4979fae0cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbc45aa-0a16-4ea8-a42a-4979fae0cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-134167498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f691c4-2bbc-498b-9419-85652b0794a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e2a2f25c9042698d04107eeb7f4817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:44Z,use_quota=True,user_id='81dc3152186b446f81255df131d1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d2f00f-6ae6-4672-a8d5-ec250845bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d2f00f-6ae6-4672-a8d5-ec250845bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57290ffe-461e-490b-83a8-8d3c4995ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57290ffe-461e-490b-83a8-8d3c4995ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f691c4-2bbc-498b-9419-85652b0794a7', 'volume_name': 'volume-a5f691c4-2bbc-498b-9419-85652b0794a7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a5e504-fcdd-477b-938f-87444897f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a5e504-fcdd-477b-938f-87444897f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ae9458-2a0e-4d68-98b6-8b0010ddb17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:44 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Volume a5f691c4-2bbc-498b-9419-85652b0794a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f691c4-2bbc-498b-9419-85652b0794a7', 'volume_size': 1} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-134167498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f691c4-2bbc-498b-9419-85652b0794a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e2a2f25c9042698d04107eeb7f4817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:31:44Z,use_quota=True,user_id='81dc3152186b446f81255df131d1a4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Creating volume a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:31:44 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-3babcd84-6c7a-4872-bde7-e0ec0ca11019-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:44 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 1073741824 Sep 22 18:31:44 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-3babcd84-6c7a-4872-bde7-e0ec0ca11019-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a369e-807b-4df3-bb5d-a6774207d997]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:44 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 Sep 22 18:31:44 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:44 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 1073741824" returned: 0 in 0.426s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:44 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:31:44 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:44 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019" returned: 0 in 0.377s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:44 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019 Sep 22 18:31:44 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:45 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ae9458-2a0e-4d68-98b6-8b0010ddb17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f691c4-2bbc-498b-9419-85652b0794a7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a35442f-229c-4e85-95df-e9c1120bb559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:31:45 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Volume volume-a5f691c4-2bbc-498b-9419-85652b0794a7 (a5f691c4-2bbc-498b-9419-85652b0794a7): created successfully Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a35442f-229c-4e85-95df-e9c1120bb559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Flow 'volume_create_manager' (2d530a5f-9516-4e9e-b9be-a8b7b186bb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:31:45 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3babcd84-6c7a-4872-bde7-e0ec0ca11019" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e055a673-6c50-4964-8160-7631fb7891b1 tempest-TestImageHashVerification-188269682 None] Created volume successfully. Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-quobyte-3babcd84-6c7a-4872-bde7-e0ec0ca11019" released by "delete_volume" :: held 0.681s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Created reservations ['e4f95ef3-f5b7-46c8-a17b-72f49480a8e0', 'a6524cc8-2d73-4a0e-b69f-de234bd14ff9', 'e9efb175-bbab-424a-8437-e77539bd16cb', 'e8079706-fc4c-4c12-a2d8-8fdd9debaedc'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:45 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:45 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:45 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Deleted volume successfully. Sep 22 18:31:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-078424ab-13f9-4b98-868a-1caa8e8775ff tempest-VolumesSnapshotListTestJSON-1834986612 None] Lock "cinder-3babcd84-6c7a-4872-bde7-e0ec0ca11019-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dadb19-2449-4ed5-83a7-1a5ea060fbae]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:46 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:31:46 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:46 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.417s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[af914050-0ced-470a-a3fd-0d4a9d75a572]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:46 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:31:46 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:47 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 /opt/stack/data/cinder/conversion/a5f691c4-2bbc-498b-9419-85652b0794a7.temp_image.b16b8575-7506-4a32-a1cd-66cec06bb91djjswe76i.img {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:47 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 /opt/stack/data/cinder/conversion/a5f691c4-2bbc-498b-9419-85652b0794a7.temp_image.b16b8575-7506-4a32-a1cd-66cec06bb91djjswe76i.img Sep 22 18:31:47 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:48 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:31:48 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:48 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.393s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:31:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:31:54 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 /opt/stack/data/cinder/conversion/a5f691c4-2bbc-498b-9419-85652b0794a7.temp_image.b16b8575-7506-4a32-a1cd-66cec06bb91djjswe76i.img" returned: 0 in 7.224s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b2ffc5-56e1-41a5-b68f-aaccc51b869b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:31:54 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:31:54 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:31:54 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.585s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/conversion/a5f691c4-2bbc-498b-9419-85652b0794a7.temp_image.b16b8575-7506-4a32-a1cd-66cec06bb91djjswe76i.img {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:31:54 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Converted 1024.00 MB image at 141.72 MB/s Sep 22 18:31:54 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] b16b8575-7506-4a32-a1cd-66cec06bb91d was raw, no need to convert to raw {{(pid=86046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 22 18:31:56 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=150,cinder:SELECT=102,cinder:INSERT=46,cinder:DELETE=10 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:32:04 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=111,cinder:SELECT=95,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:32:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.570s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Uploaded volume to glance image-id: b16b8575-7506-4a32-a1cd-66cec06bb91d. {{(pid=86046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 22 18:32:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c805ec8c-925d-4c17-b241-7ba5169c291e tempest-TestImageHashVerification-188269682 None] Copy volume to image completed successfully. Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Acquiring lock "cinder-a5f691c4-2bbc-498b-9419-85652b0794a7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "cinder-a5f691c4-2bbc-498b-9419-85652b0794a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Acquiring lock "cinder-quobyte-a5f691c4-2bbc-498b-9419-85652b0794a7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "cinder-quobyte-a5f691c4-2bbc-498b-9419-85652b0794a7" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19701c2-15d2-4718-9ba0-444f085e71e2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:17 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:32:17 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:17 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.397s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:17 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7 Sep 22 18:32:17 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:17 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a5f691c4-2bbc-498b-9419-85652b0794a7" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "cinder-quobyte-a5f691c4-2bbc-498b-9419-85652b0794a7" released by "delete_volume" :: held 0.705s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Created reservations ['aa586774-2ac1-400e-81c8-7cb798fb8d62', 'e101a677-ac62-48aa-b983-2be4fa198249', '11867d19-a100-4ba1-a2f7-ddcadf313be7', 'c2a2aa36-bf5c-495e-927a-97cfa8bb0f34'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:18 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:18 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:18 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.285s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Deleted volume successfully. Sep 22 18:32:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-93ada58a-9d5c-471c-ba1c-4840c9066cc3 tempest-TestImageHashVerification-188269682 None] Lock "cinder-a5f691c4-2bbc-498b-9419-85652b0794a7-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Flow 'volume_create_manager' (12e0b7cc-67fd-4113-adbc-5bdcc6ebbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10b5879-1c65-4b67-adb0-62c1390209a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10b5879-1c65-4b67-adb0-62c1390209a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2010536382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04ebac1-e114-4a11-934f-3d78576fde5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f4b8f3b41742f5bd9393d61778c36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:28Z,use_quota=True,user_id='d62dfe57cbc44f7d98f512fb6f0a534f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f51569-b138-4669-bd42-7f9588cdb0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f51569-b138-4669-bd42-7f9588cdb0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aace5817-d8b1-4ba0-b6f0-e5a7f292621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aace5817-d8b1-4ba0-b6f0-e5a7f292621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04ebac1-e114-4a11-934f-3d78576fde5e', 'volume_name': 'volume-d04ebac1-e114-4a11-934f-3d78576fde5e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefd1a0c-750e-44e4-81b6-ccd9e80caca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefd1a0c-750e-44e4-81b6-ccd9e80caca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5323a7a3-624e-4388-b166-db2980613297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Volume d04ebac1-e114-4a11-934f-3d78576fde5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04ebac1-e114-4a11-934f-3d78576fde5e', 'volume_size': 1} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2010536382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04ebac1-e114-4a11-934f-3d78576fde5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f4b8f3b41742f5bd9393d61778c36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:28Z,use_quota=True,user_id='d62dfe57cbc44f7d98f512fb6f0a534f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Creating volume d04ebac1-e114-4a11-934f-3d78576fde5e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:28 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:28 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e 1073741824 Sep 22 18:32:28 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:28 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e 1073741824" returned: 0 in 0.636s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:28 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e Sep 22 18:32:28 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:29 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e" returned: 0 in 0.272s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5323a7a3-624e-4388-b166-db2980613297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04ebac1-e114-4a11-934f-3d78576fde5e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf40469a-0b68-4364-b793-a4f04aa4fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:29 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Volume volume-d04ebac1-e114-4a11-934f-3d78576fde5e (d04ebac1-e114-4a11-934f-3d78576fde5e): created successfully Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf40469a-0b68-4364-b793-a4f04aa4fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Flow 'volume_create_manager' (12e0b7cc-67fd-4113-adbc-5bdcc6ebbfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8dd22fa4-5c02-48a5-8d19-5514819adc2f tempest-TestMinimumBasicScenario-1520409038 None] Created volume successfully. Sep 22 18:32:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-5e783490-847b-4478-bfce-085afd65d339 req-34bf7eb7-5d39-4f4b-a929-8c8ed3235254 tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-5e783490-847b-4478-bfce-085afd65d339 req-34bf7eb7-5d39-4f4b-a929-8c8ed3235254 tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-5e783490-847b-4478-bfce-085afd65d339 req-34bf7eb7-5d39-4f4b-a929-8c8ed3235254 tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-5e783490-847b-4478-bfce-085afd65d339 req-34bf7eb7-5d39-4f4b-a929-8c8ed3235254 tempest-TestMinimumBasicScenario-1520409038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-d04ebac1-e114-4a11-934f-3d78576fde5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '918901eb-53eb-4097-9136-af5fc67c7b9f', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:32:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-5e783490-847b-4478-bfce-085afd65d339 req-34bf7eb7-5d39-4f4b-a929-8c8ed3235254 tempest-TestMinimumBasicScenario-1520409038 None] attachment_update completed successfully. Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (436f1349-32ba-43d2-aee7-2f5a520d29fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568e8462-f760-4c2f-af0b-6681e1068809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568e8462-f760-4c2f-af0b-6681e1068809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725882132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db0e25e-b0db-4e98-8ffb-566ab386161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:32Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b41dbc-4867-4ad3-a97b-fdda0307302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b41dbc-4867-4ad3-a97b-fdda0307302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b68e4-b2ba-49f1-92c5-54666907f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b68e4-b2ba-49f1-92c5-54666907f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db0e25e-b0db-4e98-8ffb-566ab386161a', 'volume_name': 'volume-2db0e25e-b0db-4e98-8ffb-566ab386161a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e97a49-5321-488e-9ea2-cc46be83edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e97a49-5321-488e-9ea2-cc46be83edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178cdfb0-216f-4859-a2fd-79246eb09ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:32 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Volume 2db0e25e-b0db-4e98-8ffb-566ab386161a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db0e25e-b0db-4e98-8ffb-566ab386161a', 'volume_size': 1} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725882132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db0e25e-b0db-4e98-8ffb-566ab386161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:32Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Creating volume 2db0e25e-b0db-4e98-8ffb-566ab386161a {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:32 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:32 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a 1073741824 Sep 22 18:32:32 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (724c6a0d-1b33-4a89-9ac2-c0991c62da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b43327-689e-466b-804c-58af6713f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b43327-689e-466b-804c-58af6713f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698276755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402efbea-f600-445b-95d3-2f480a1ec516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:33Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679b6bf7-86e1-4d64-93ad-02c2cafecf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679b6bf7-86e1-4d64-93ad-02c2cafecf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e14f1-0f9e-4d14-b88c-7709a341c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e14f1-0f9e-4d14-b88c-7709a341c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402efbea-f600-445b-95d3-2f480a1ec516', 'volume_name': 'volume-402efbea-f600-445b-95d3-2f480a1ec516', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9e4bdb-9814-492d-8e60-e867d4a14144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9e4bdb-9814-492d-8e60-e867d4a14144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2b49b5-b97c-4410-a056-c4191cbc6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Volume 402efbea-f600-445b-95d3-2f480a1ec516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402efbea-f600-445b-95d3-2f480a1ec516', 'volume_size': 1} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:33 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a 1073741824" returned: 0 in 0.649s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:33 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a Sep 22 18:32:33 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (2c61e9c5-2f45-4cdc-a8c0-3cc9258d1630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7dd8c8-5377-4d42-9301-e3770868d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7dd8c8-5377-4d42-9301-e3770868d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853665566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cc0e09-b36c-4d06-99d0-4fc71ea23c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:33Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907a2234-0bef-43d2-84e2-c964ba9aa0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907a2234-0bef-43d2-84e2-c964ba9aa0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4145f31-6b98-432c-a58c-5411512e188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4145f31-6b98-432c-a58c-5411512e188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91cc0e09-b36c-4d06-99d0-4fc71ea23c79', 'volume_name': 'volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d994d4d-bf93-447d-a4dc-ac0918e715bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d994d4d-bf93-447d-a4dc-ac0918e715bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077cf501-b3f2-4525-8a7c-88c908156004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Volume 91cc0e09-b36c-4d06-99d0-4fc71ea23c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79', 'volume_size': 1} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:33 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a" returned: 0 in 0.401s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698276755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402efbea-f600-445b-95d3-2f480a1ec516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:33Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Creating volume 402efbea-f600-445b-95d3-2f480a1ec516 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:33 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:33 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 1073741824 Sep 22 18:32:33 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178cdfb0-216f-4859-a2fd-79246eb09ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db0e25e-b0db-4e98-8ffb-566ab386161a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03163d65-6a69-4a3b-ad0d-7a8d3a44cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Volume volume-2db0e25e-b0db-4e98-8ffb-566ab386161a (2db0e25e-b0db-4e98-8ffb-566ab386161a): created successfully Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03163d65-6a69-4a3b-ad0d-7a8d3a44cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (436f1349-32ba-43d2-aee7-2f5a520d29fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:33 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7cdceed9-3222-44c1-9013-a142e25ca030 tempest-CreateVolumesFromImageTest-1091214847 None] Created volume successfully. Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (9c3b3a03-ad4c-47bd-8edb-935fd102b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f018f-e9c1-42c6-9a39-2d3d8759e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f018f-e9c1-42c6-9a39-2d3d8759e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694745939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ca6e19-91c5-444a-b9e9-297060d87a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:34Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b52bc5-ccd4-43e6-87a3-2b12d458f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b52bc5-ccd4-43e6-87a3-2b12d458f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e758b8-e34d-470e-af86-20afa2eedd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e758b8-e34d-470e-af86-20afa2eedd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ca6e19-91c5-444a-b9e9-297060d87a2e', 'volume_name': 'volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcdf274-3044-45d4-bba9-c90e325d2a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:34 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcdf274-3044-45d4-bba9-c90e325d2a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962bd67-705a-4a7b-9861-ba3d25ed2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Volume f0ca6e19-91c5-444a-b9e9-297060d87a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e', 'volume_size': 1} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 1073741824" returned: 0 in 0.783s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:34 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 Sep 22 18:32:34 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (888eb1a2-81db-4661-b766-3cb9412ab076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7db3a7-bf1d-489a-891d-9710d7686973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516" returned: 0 in 0.446s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853665566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cc0e09-b36c-4d06-99d0-4fc71ea23c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:33Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Creating volume 91cc0e09-b36c-4d06-99d0-4fc71ea23c79 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:35 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7db3a7-bf1d-489a-891d-9710d7686973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160833666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ceac3-86d9-41b5-9a47-b977f5c4cb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:35Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bdfb63-f602-4566-b338-4f8f94f9f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 1073741824 Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bdfb63-f602-4566-b338-4f8f94f9f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0018a52-8879-4f71-9f07-d9731ff7658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0018a52-8879-4f71-9f07-d9731ff7658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82ceac3-86d9-41b5-9a47-b977f5c4cb58', 'volume_name': 'volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d592aa5f-3d5f-4901-b6d6-d96b21acfa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d592aa5f-3d5f-4901-b6d6-d96b21acfa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039b2df-72dc-4414-a538-2ef96ab0f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Volume f82ceac3-86d9-41b5-9a47-b977f5c4cb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58', 'volume_size': 1} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2b49b5-b97c-4410-a056-c4191cbc6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402efbea-f600-445b-95d3-2f480a1ec516', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f71ab-3640-47f0-9202-493ddeb65c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Volume volume-402efbea-f600-445b-95d3-2f480a1ec516 (402efbea-f600-445b-95d3-2f480a1ec516): created successfully Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f71ab-3640-47f0-9202-493ddeb65c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (724c6a0d-1b33-4a89-9ac2-c0991c62da14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5a145141-5360-40e4-8033-cd43d006951e tempest-CreateVolumesFromImageTest-1091214847 None] Created volume successfully. Sep 22 18:32:35 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 1073741824" returned: 0 in 0.557s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:35 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 Sep 22 18:32:35 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:35 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694745939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ca6e19-91c5-444a-b9e9-297060d87a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:34Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Creating volume f0ca6e19-91c5-444a-b9e9-297060d87a2e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:36 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:36 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e 1073741824 Sep 22 18:32:36 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077cf501-b3f2-4525-8a7c-88c908156004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49a0b38-3df3-40f4-9984-b755552a51dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Volume volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 (91cc0e09-b36c-4d06-99d0-4fc71ea23c79): created successfully Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49a0b38-3df3-40f4-9984-b755552a51dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (2c61e9c5-2f45-4cdc-a8c0-3cc9258d1630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9da64463-7b37-441e-a6cb-97b1280421be tempest-CreateVolumesFromImageTest-1091214847 None] Created volume successfully. Sep 22 18:32:36 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e 1073741824" returned: 0 in 0.489s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:36 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e Sep 22 18:32:36 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:36 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e" returned: 0 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160833666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ceac3-86d9-41b5-9a47-b977f5c4cb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a0b560e3a2c45828fe3fe975b2153da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:35Z,use_quota=True,user_id='cee86818dbc84ff69fba97cdd3a9cd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Creating volume f82ceac3-86d9-41b5-9a47-b977f5c4cb58 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:36 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962bd67-705a-4a7b-9861-ba3d25ed2071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c9267-8d45-4f1e-957b-db612bd91a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:36 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 1073741824 Sep 22 18:32:36 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Volume volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e (f0ca6e19-91c5-444a-b9e9-297060d87a2e): created successfully Sep 22 18:32:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c9267-8d45-4f1e-957b-db612bd91a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (9c3b3a03-ad4c-47bd-8edb-935fd102b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-182b8b27-991a-4efe-94cd-a1323f6056b9 tempest-CreateVolumesFromImageTest-1091214847 None] Created volume successfully. Sep 22 18:32:37 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 1073741824" returned: 0 in 0.720s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:37 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 Sep 22 18:32:37 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:38 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039b2df-72dc-4414-a538-2ef96ab0f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e07d58-6b69-4eba-9559-334089dc9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:38 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Volume volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 (f82ceac3-86d9-41b5-9a47-b977f5c4cb58): created successfully Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e07d58-6b69-4eba-9559-334089dc9077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Flow 'volume_create_manager' (888eb1a2-81db-4661-b766-3cb9412ab076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5c963aa8-843e-464e-8b53-a666b5984b40 tempest-CreateVolumesFromImageTest-1091214847 None] Created volume successfully. Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-f82ceac3-86d9-41b5-9a47-b977f5c4cb58-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-f82ceac3-86d9-41b5-9a47-b977f5c4cb58-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-quobyte-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f33d2-cca3-4af5-bd3d-0a9163248bee]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:38 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 Sep 22 18:32:38 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:39 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" returned: 0 in 0.458s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:39 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58 Sep 22 18:32:39 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:39 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-f82ceac3-86d9-41b5-9a47-b977f5c4cb58" released by "delete_volume" :: held 0.796s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Created reservations ['083cb339-e5b5-4e16-ad7e-7ec81fb6f5a9', '03c260ff-c782-4a74-9084-3e1454741419', '4f2500a7-4c49-41d8-ba5a-59ed932db965', '231bf950-8b7e-45af-83c8-1548d6e2efd9'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:39 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:39 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-f0ca6e19-91c5-444a-b9e9-297060d87a2e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-f0ca6e19-91c5-444a-b9e9-297060d87a2e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-quobyte-f0ca6e19-91c5-444a-b9e9-297060d87a2e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-f0ca6e19-91c5-444a-b9e9-297060d87a2e" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfae2f-37c6-4644-8c67-a09f645a0bdf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:40 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.335s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Deleted volume successfully. Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbd03970-bb5b-458a-b15d-73b272a90f94 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-f82ceac3-86d9-41b5-9a47-b977f5c4cb58-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:40 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e Sep 22 18:32:40 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:40 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:40 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e Sep 22 18:32:40 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:40 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f0ca6e19-91c5-444a-b9e9-297060d87a2e" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-f0ca6e19-91c5-444a-b9e9-297060d87a2e" released by "delete_volume" :: held 0.737s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Created reservations ['8e9a4906-4e93-4e5b-9261-261e0efb2faf', '701dd832-1a3c-4567-ae7b-f2a0ac35811b', '3ed5cca6-634e-4440-9382-97b0603b0791', '6147a19d-4acd-49b0-a112-73d57be99325'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:40 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:40 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-91cc0e09-b36c-4d06-99d0-4fc71ea23c79-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-91cc0e09-b36c-4d06-99d0-4fc71ea23c79-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:41 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-quobyte-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Deleted volume successfully. Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dd2bafba-4aac-4b00-9e6c-e3047650fe31 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-f0ca6e19-91c5-444a-b9e9-297060d87a2e-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d343f9c1-a27c-4061-80c7-e5e03b68ff9a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:41 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 Sep 22 18:32:41 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:41 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" returned: 0 in 0.421s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:41 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79 Sep 22 18:32:41 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:41 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-91cc0e09-b36c-4d06-99d0-4fc71ea23c79" released by "delete_volume" :: held 0.744s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:41 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Created reservations ['a6aa05af-481a-42e6-9c13-6238266f3b49', 'd0f1a838-392e-400e-92bb-25d9064331d4', '18e52997-47c7-4834-ac75-a45e830d12ce', '12549d01-bd82-44cb-82a8-6f197a7d7a56'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:42 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:42 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-402efbea-f600-445b-95d3-2f480a1ec516-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-402efbea-f600-445b-95d3-2f480a1ec516-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:42 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Deleted volume successfully. Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-quobyte-402efbea-f600-445b-95d3-2f480a1ec516" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-402efbea-f600-445b-95d3-2f480a1ec516" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-412c6255-e39b-4bdb-947a-f35f7f35c4ed tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-91cc0e09-b36c-4d06-99d0-4fc71ea23c79-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d156045b-b82f-44d9-972a-b17449e2e043]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:42 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 Sep 22 18:32:42 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:42 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516" returned: 0 in 0.392s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:42 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516 Sep 22 18:32:42 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:43 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-402efbea-f600-445b-95d3-2f480a1ec516" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-402efbea-f600-445b-95d3-2f480a1ec516" released by "delete_volume" :: held 0.694s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Created reservations ['58b167e7-ca34-4564-a8a4-3d6e9100f266', '8a2d6da8-f23f-4650-8b24-375223c8f57b', 'fbde9285-0fdf-456a-b6e5-c5c25c46f768', '5f82610d-e763-4a52-874c-7fe7c44ee29e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:43 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:43 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:43 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Deleted volume successfully. Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-14d3a5b5-ec3f-49d8-b32b-169bdbf64721 tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-402efbea-f600-445b-95d3-2f480a1ec516-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-2db0e25e-b0db-4e98-8ffb-566ab386161a-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-2db0e25e-b0db-4e98-8ffb-566ab386161a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "cinder-quobyte-2db0e25e-b0db-4e98-8ffb-566ab386161a" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-2db0e25e-b0db-4e98-8ffb-566ab386161a" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1affc6f9-3310-4cab-88f8-31b862395580]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:43 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a Sep 22 18:32:43 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:43 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a" returned: 0 in 0.408s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:43 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a Sep 22 18:32:43 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:44 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2db0e25e-b0db-4e98-8ffb-566ab386161a" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-quobyte-2db0e25e-b0db-4e98-8ffb-566ab386161a" released by "delete_volume" :: held 0.712s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Created reservations ['7ac2e975-7065-4290-a3ee-5663f020c903', 'c57f2923-9d49-4d04-a1c2-b1eb37e9a049', '4040deca-428c-4166-b330-d898778b085b', '9c537348-902f-4692-b8a8-8e7c35da80b2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:44 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:44 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:44 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:44 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Deleted volume successfully. Sep 22 18:32:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2097b463-199c-44b1-ac99-485db4aaa92b tempest-CreateVolumesFromImageTest-1091214847 None] Lock "cinder-2db0e25e-b0db-4e98-8ffb-566ab386161a-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (593f632f-be1e-428c-b326-2229aeff8384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c795b1-152e-4743-9e1f-3d8cb0a57e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c795b1-152e-4743-9e1f-3d8cb0a57e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484098582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461b9a09-4c51-415e-8a2b-ab83289079a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:48Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294980e9-11ef-45f8-9b7c-2129d692e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294980e9-11ef-45f8-9b7c-2129d692e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f420f48-1418-4835-8478-db802e5a96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f420f48-1418-4835-8478-db802e5a96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461b9a09-4c51-415e-8a2b-ab83289079a8', 'volume_name': 'volume-461b9a09-4c51-415e-8a2b-ab83289079a8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef69180-6b00-4316-a28f-42b04f1a699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef69180-6b00-4316-a28f-42b04f1a699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cff76f9-1fc9-4c6c-a636-6f136dc70586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Volume 461b9a09-4c51-415e-8a2b-ab83289079a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461b9a09-4c51-415e-8a2b-ab83289079a8', 'volume_size': 1} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484098582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461b9a09-4c51-415e-8a2b-ab83289079a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:48Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Creating volume 461b9a09-4c51-415e-8a2b-ab83289079a8 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:48 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:48 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 1073741824 Sep 22 18:32:48 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:48 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:48 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:48 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 1073741824" returned: 0 in 0.531s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:48 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:32:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:48 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 Sep 22 18:32:48 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:49 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8" returned: 0 in 0.270s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cff76f9-1fc9-4c6c-a636-6f136dc70586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461b9a09-4c51-415e-8a2b-ab83289079a8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9792599e-efaf-4eaf-9eb5-c5256e3b59e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Volume volume-461b9a09-4c51-415e-8a2b-ab83289079a8 (461b9a09-4c51-415e-8a2b-ab83289079a8): created successfully Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9792599e-efaf-4eaf-9eb5-c5256e3b59e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (593f632f-be1e-428c-b326-2229aeff8384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1d63b94a-2835-46f2-9a10-9e79fb8bb595 tempest-ProjectReaderTests-1617187251 None] Created volume successfully. Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-461b9a09-4c51-415e-8a2b-ab83289079a8-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "cinder-461b9a09-4c51-415e-8a2b-ab83289079a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-quobyte-461b9a09-4c51-415e-8a2b-ab83289079a8" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-461b9a09-4c51-415e-8a2b-ab83289079a8" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383b821-465c-4363-99d5-246822a6d8bf]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:50 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 Sep 22 18:32:50 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:50 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:51 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8 Sep 22 18:32:51 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:51 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-461b9a09-4c51-415e-8a2b-ab83289079a8" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-461b9a09-4c51-415e-8a2b-ab83289079a8" released by "delete_volume" :: held 0.742s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Created reservations ['e57d9fa5-ad31-4d01-bc0a-7e07f414c2c6', '5198e5fc-e289-4dcd-a300-9fe6360a2389', '2f1a8fdc-8966-454a-9da9-8f947bb402da', 'a9d2327f-dd03-4f55-879f-97adb24681a0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:51 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:51 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:51 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Deleted volume successfully. Sep 22 18:32:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3139fe19-159e-4293-900b-eff5fff84a7b tempest-ProjectReaderTests-1617187251 None] Lock "cinder-461b9a09-4c51-415e-8a2b-ab83289079a8-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (0fe3e2f0-e83b-4d7b-ba0f-25b41197f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849181ca-a819-49ce-a6e6-063c8ec9f19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849181ca-a819-49ce-a6e6-063c8ec9f19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3cba0d-79f8-4359-9096-3d507197a1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:52Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b14fb8c-5cd5-49f5-afc0-a50bed93dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b14fb8c-5cd5-49f5-afc0-a50bed93dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cdef28-b3d6-4f75-a16b-4f574905ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cdef28-b3d6-4f75-a16b-4f574905ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3cba0d-79f8-4359-9096-3d507197a1b8', 'volume_name': 'volume-3b3cba0d-79f8-4359-9096-3d507197a1b8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311f10a9-63bc-4b66-ba3b-3c54578d9adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311f10a9-63bc-4b66-ba3b-3c54578d9adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c083477a-3d92-491e-b7d2-18c9060e9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Volume 3b3cba0d-79f8-4359-9096-3d507197a1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3cba0d-79f8-4359-9096-3d507197a1b8', 'volume_size': 1} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3cba0d-79f8-4359-9096-3d507197a1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:52Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Creating volume 3b3cba0d-79f8-4359-9096-3d507197a1b8 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:52 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:52 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 1073741824 Sep 22 18:32:52 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:52 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 1073741824" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:52 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 Sep 22 18:32:52 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:52 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c083477a-3d92-491e-b7d2-18c9060e9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3cba0d-79f8-4359-9096-3d507197a1b8', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504a1d5d-a78e-44ed-8d3e-163b8c47c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:52 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Volume volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 (3b3cba0d-79f8-4359-9096-3d507197a1b8): created successfully Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504a1d5d-a78e-44ed-8d3e-163b8c47c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:52 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (0fe3e2f0-e83b-4d7b-ba0f-25b41197f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-97c09c2d-4262-43a0-91a0-fbf062303312 tempest-ProjectReaderTests-1617187251 None] Created volume successfully. Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-3b3cba0d-79f8-4359-9096-3d507197a1b8-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "cinder-3b3cba0d-79f8-4359-9096-3d507197a1b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-quobyte-3b3cba0d-79f8-4359-9096-3d507197a1b8" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-3b3cba0d-79f8-4359-9096-3d507197a1b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba03a5a-6c04-44a7-99bb-9ad9413464ba]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:53 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 Sep 22 18:32:53 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:53 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8" returned: 0 in 0.450s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:53 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8 Sep 22 18:32:53 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:53 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-3b3cba0d-79f8-4359-9096-3d507197a1b8" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-3b3cba0d-79f8-4359-9096-3d507197a1b8" released by "delete_volume" :: held 0.784s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Created reservations ['9260923e-942d-4584-8173-558f75353a58', '56978660-94d9-4e65-bc24-e898d51af0f2', '2065cac2-9c09-4dcc-b62d-5874af6ae9d0', 'bf2d5d87-08d7-496b-b7cd-fa7b892a651f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:54 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:54 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:54 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.281s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Deleted volume successfully. Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-596b7789-8e0a-4a15-a50e-be198057768d tempest-ProjectReaderTests-1617187251 None] Lock "cinder-3b3cba0d-79f8-4359-9096-3d507197a1b8-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (b322f550-26c0-4156-be4c-172d7cd97351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb300c5f-979d-4ce1-b327-f07c8d3df95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb300c5f-979d-4ce1-b327-f07c8d3df95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862803188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c473b9-6f43-47ef-89a5-e1de69c4a5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:55Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d774de-2945-42fd-9a17-8b611b91790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d774de-2945-42fd-9a17-8b611b91790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fe8e76-21ef-4a0c-a975-13a4b04189c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38fe8e76-21ef-4a0c-a975-13a4b04189c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c473b9-6f43-47ef-89a5-e1de69c4a5d9', 'volume_name': 'volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d2bad-a214-493c-97bc-d365fe03abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d2bad-a214-493c-97bc-d365fe03abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265f52c-f13d-4f49-8022-bd69d062146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Volume 15c473b9-6f43-47ef-89a5-e1de69c4a5d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9', 'volume_size': 1} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862803188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c473b9-6f43-47ef-89a5-e1de69c4a5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:55Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Creating volume 15c473b9-6f43-47ef-89a5-e1de69c4a5d9 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:54 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 1073741824 Sep 22 18:32:54 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:55 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 1073741824" returned: 0 in 0.461s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:55 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 Sep 22 18:32:55 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:55 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" returned: 0 in 0.246s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0265f52c-f13d-4f49-8022-bd69d062146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910f3d0a-7156-4781-b4d9-4b77ad1a0289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Volume volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 (15c473b9-6f43-47ef-89a5-e1de69c4a5d9): created successfully Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910f3d0a-7156-4781-b4d9-4b77ad1a0289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (b322f550-26c0-4156-be4c-172d7cd97351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:55 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fb7f299c-8ec2-42ca-b876-07a32dfd5b93 tempest-ProjectReaderTests-1617187251 None] Created volume successfully. Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-15c473b9-6f43-47ef-89a5-e1de69c4a5d9-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-15c473b9-6f43-47ef-89a5-e1de69c4a5d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-quobyte-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb308bcc-5990-434d-8b2d-d16f5c3f7705]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:56 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 Sep 22 18:32:56 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:56 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:56 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9 Sep 22 18:32:56 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:56 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-15c473b9-6f43-47ef-89a5-e1de69c4a5d9" released by "delete_volume" :: held 0.654s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Created reservations ['37685b93-2f68-473f-b88b-1ec4c0285813', '0c525c01-703f-45c9-964a-11d234fd398b', '84e54cce-00cb-4ad8-967c-30f43e16ec72', '53105d85-ceee-4a35-b792-caecc4318c6e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:56 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:56 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:56 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:56 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:56 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Deleted volume successfully. Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f477fe3-1694-4b90-95c8-f81ebbc76567 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-15c473b9-6f43-47ef-89a5-e1de69c4a5d9-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (f58d2ea9-35fb-4a75-9e42-6a4be426bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac1feb-32ab-4373-a372-bf86ce58ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac1feb-32ab-4373-a372-bf86ce58ef69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115138050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604d628-e75d-485b-ae10-9765519485fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:57Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be48132b-0305-4674-9c0f-7fa060e98540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be48132b-0305-4674-9c0f-7fa060e98540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a274da9d-a447-48a1-ab52-b908303e7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a274da9d-a447-48a1-ab52-b908303e7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8604d628-e75d-485b-ae10-9765519485fb', 'volume_name': 'volume-8604d628-e75d-485b-ae10-9765519485fb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178f60f2-3bc8-4401-a160-733bac9b90d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178f60f2-3bc8-4401-a160-733bac9b90d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9b4b23-99d8-4bcc-b350-a9e7bdb5a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Volume 8604d628-e75d-485b-ae10-9765519485fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8604d628-e75d-485b-ae10-9765519485fb', 'volume_size': 1} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115138050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604d628-e75d-485b-ae10-9765519485fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e51b1acb7434b90ab109c78dd909c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:32:57Z,use_quota=True,user_id='908c9bdf80f04a589c8c26750e326439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Creating volume 8604d628-e75d-485b-ae10-9765519485fb {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:32:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:32:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:57 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb 1073741824 Sep 22 18:32:57 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:58 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb 1073741824" returned: 0 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:58 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb Sep 22 18:32:58 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:58 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9b4b23-99d8-4bcc-b350-a9e7bdb5a782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8604d628-e75d-485b-ae10-9765519485fb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b029ee-bea3-49f6-bfa4-1c785e86a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:32:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Volume volume-8604d628-e75d-485b-ae10-9765519485fb (8604d628-e75d-485b-ae10-9765519485fb): created successfully Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b029ee-bea3-49f6-bfa4-1c785e86a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Flow 'volume_create_manager' (f58d2ea9-35fb-4a75-9e42-6a4be426bf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:32:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-66520296-2bbd-411c-9170-6e1bcaa0c800 tempest-ProjectReaderTests-1617187251 None] Created volume successfully. Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-8604d628-e75d-485b-ae10-9765519485fb-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-8604d628-e75d-485b-ae10-9765519485fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "cinder-quobyte-8604d628-e75d-485b-ae10-9765519485fb" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-8604d628-e75d-485b-ae10-9765519485fb" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d24af-ea66-4b22-8b74-51df766c0e83]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:32:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:58 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb Sep 22 18:32:58 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:59 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb" returned: 0 in 0.347s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:59 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb Sep 22 18:32:59 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:59 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8604d628-e75d-485b-ae10-9765519485fb" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-quobyte-8604d628-e75d-485b-ae10-9765519485fb" released by "delete_volume" :: held 0.616s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Created reservations ['baaaf533-52ab-4c16-a9e9-9728e89d8121', '8f89e0ef-3451-4841-b48d-1b08477cf15c', '7ef92cbd-49d8-4407-93e5-6df5b3649c9c', 'd0bb9ee3-7848-4518-8450-725d19b4be85'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:32:59 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:32:59 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:32:59 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:32:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Deleted volume successfully. Sep 22 18:32:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-367771d7-68ae-4864-bf3d-f2c7f838f153 tempest-ProjectReaderTests-1617187251 None] Lock "cinder-8604d628-e75d-485b-ae10-9765519485fb-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:33:09 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=76,cinder:UPDATE=94,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:33:09 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=74,cinder:UPDATE=124,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:33:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-aacb3afd-5690-49ec-afbc-dd2c2931cda9 req-f9905898-fc18-48d2-93a5-ae11cfceafbf tempest-TestMinimumBasicScenario-1520409038 None] Terminate volume connection completed successfully. Sep 22 18:33:17 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-aacb3afd-5690-49ec-afbc-dd2c2931cda9 req-f9905898-fc18-48d2-93a5-ae11cfceafbf tempest-TestMinimumBasicScenario-1520409038 None] Deleting attachment 918901eb-53eb-4097-9136-af5fc67c7b9f. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "cinder-d04ebac1-e114-4a11-934f-3d78576fde5e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "cinder-d04ebac1-e114-4a11-934f-3d78576fde5e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "cinder-quobyte-d04ebac1-e114-4a11-934f-3d78576fde5e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "cinder-quobyte-d04ebac1-e114-4a11-934f-3d78576fde5e" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a8e50-9265-4a2f-8b2e-a3a3f5956be7]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:18 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e Sep 22 18:33:18 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:18 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e" returned: 0 in 0.350s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:18 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e Sep 22 18:33:18 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:18 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d04ebac1-e114-4a11-934f-3d78576fde5e" returned: 0 in 0.232s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "cinder-quobyte-d04ebac1-e114-4a11-934f-3d78576fde5e" released by "delete_volume" :: held 0.619s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Created reservations ['235ee9fb-818d-4edc-9ebf-57a36c1e6b6c', '31be0471-aec9-4115-9214-493544303288', '67df02a4-3468-4193-be6f-c3375e9a2e14', '5494eed7-431a-4684-9ade-92a331e16e60'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:33:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:18 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:33:18 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:19 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:19 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:33:19 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Deleted volume successfully. Sep 22 18:33:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d0e7b1da-e3a1-47a3-bf16-aad286dc2040 tempest-TestMinimumBasicScenario-1520409038 None] Lock "cinder-d04ebac1-e114-4a11-934f-3d78576fde5e-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:33:28 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:33:29 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:48 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:33:48 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:48 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:33:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Flow 'volume_create_manager' (1c23980d-5b35-482e-89db-5c491574f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ccce24-f8af-47d6-9d9e-67e4dd352ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ccce24-f8af-47d6-9d9e-67e4dd352ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901140539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b5101-96a7-4a62-a31d-565d33ca0da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8440126bcf364ca6960988884aa769b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:33:56Z,use_quota=True,user_id='8aaf9a37985a4040b2cc58dc1f92f2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c55895-2474-4f8e-9e7e-d5995995b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c55895-2474-4f8e-9e7e-d5995995b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e33b0-bfe1-4927-8608-4209f174631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e33b0-bfe1-4927-8608-4209f174631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f92b5101-96a7-4a62-a31d-565d33ca0da9', 'volume_name': 'volume-f92b5101-96a7-4a62-a31d-565d33ca0da9', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee07f56-257a-428b-96c9-b3f86fa2099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee07f56-257a-428b-96c9-b3f86fa2099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794ae03-49dc-4f08-afb4-a56d28839bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:33:56 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Volume f92b5101-96a7-4a62-a31d-565d33ca0da9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f92b5101-96a7-4a62-a31d-565d33ca0da9', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 18:33:56 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Trying to clone f92b5101-96a7-4a62-a31d-565d33ca0da9 from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:33:57 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Image download 20.69 MB at 20.69 MB/s Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf190d-3885-4179-971b-5d2201b12e7c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:57 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD Sep 22 18:33:57 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:57 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD" returned: 0 in 0.305s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 is fetched for user 8aaf9a37985a4040b2cc58dc1f92f2c4. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca854c5-6ca1-4a89-8188-176e2d6af022]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:57 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD Sep 22 18:33:57 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:57 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901140539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92b5101-96a7-4a62-a31d-565d33ca0da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8440126bcf364ca6960988884aa769b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:33:56Z,use_quota=True,user_id='8aaf9a37985a4040b2cc58dc1f92f2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Creating volume f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:33:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:33:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:57 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1073741824 Sep 22 18:33:57 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:58 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1073741824" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:58 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 Sep 22 18:33:58 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:58 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Attempting download of 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume f92b5101-96a7-4a62-a31d-565d33ca0da9. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ed081e-6375-4dda-863e-b1087fa3f70f]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:58 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9 Sep 22 18:33:58 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:58 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9" returned: 0 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:59 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9 Sep 22 18:33:59 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:59 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9" returned: 1 in 0.309s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_79jrsja9' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e2e9b4-4b68-44d4-a994-cb85b12219d3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:59 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD Sep 22 18:33:59 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:33:59 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD" returned: 0 in 0.307s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 was qcow2, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:33:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:33:59 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 Sep 22 18:33:59 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:34:01 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9" returned: 0 in 1.621s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0f0cc6-7924-409d-a9fa-cb2d31398c00_p_7sg8fvdevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:34:01 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Converted 112.00 MB image at 69.05 MB/s Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:34:01 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1G Sep 22 18:34:01 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:34:01 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 1G" returned: 0 in 0.291s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Downloaded image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}])) to volume f92b5101-96a7-4a62-a31d-565d33ca0da9 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Temporary image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 for user 8aaf9a37985a4040b2cc58dc1f92f2c4 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Marking volume f92b5101-96a7-4a62-a31d-565d33ca0da9 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Copying metadata from image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 to f92b5101-96a7-4a62-a31d-565d33ca0da9. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Creating volume glance metadata for volume f92b5101-96a7-4a62-a31d-565d33ca0da9 backed by image 8d0f0cc6-7924-409d-a9fa-cb2d31398c00 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794ae03-49dc-4f08-afb4-a56d28839bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92b5101-96a7-4a62-a31d-565d33ca0da9', 'volume_size': 1, 'image_id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '71aefdd828654245b3dd07911c16cad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0f0cc6-7924-409d-a9fa-cb2d31398c00', 'created_at': datetime.datetime(2026, 9, 22, 16, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0f0cc6-7924-409d-a9fa-cb2d31398c00/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84465092-a3b8-4bc1-8fd1-6f335d2bfec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:34:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Volume volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 (f92b5101-96a7-4a62-a31d-565d33ca0da9): created successfully Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84465092-a3b8-4bc1-8fd1-6f335d2bfec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:34:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Flow 'volume_create_manager' (1c23980d-5b35-482e-89db-5c491574f799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:34:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-89da617b-8f9f-4be8-b95f-5be2ebf2989e tempest-TestShelveInstance-223188407 None] Created volume successfully. Sep 22 18:34:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e7abb8e2-7d0a-41dc-a134-63d888f848bf req-3ae7c7ae-4adc-4ca2-a606-5af3a4901403 tempest-TestShelveInstance-223188407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:34:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e7abb8e2-7d0a-41dc-a134-63d888f848bf req-3ae7c7ae-4adc-4ca2-a606-5af3a4901403 tempest-TestShelveInstance-223188407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:34:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e7abb8e2-7d0a-41dc-a134-63d888f848bf req-3ae7c7ae-4adc-4ca2-a606-5af3a4901403 tempest-TestShelveInstance-223188407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:34:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-e7abb8e2-7d0a-41dc-a134-63d888f848bf req-3ae7c7ae-4adc-4ca2-a606-5af3a4901403 tempest-TestShelveInstance-223188407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-f92b5101-96a7-4a62-a31d-565d33ca0da9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4db4748-7069-4814-a172-04b5b78e37e5', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:34:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-e7abb8e2-7d0a-41dc-a134-63d888f848bf req-3ae7c7ae-4adc-4ca2-a606-5af3a4901403 tempest-TestShelveInstance-223188407 None] attachment_update completed successfully. Sep 22 18:34:14 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=8 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:34:14 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=5,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:34:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-a6675ff3-3754-4ccf-bb97-df1c7409c140 req-8b47bd0d-9999-446c-90cc-9ed113db507b tempest-TestShelveInstance-223188407 None] Terminate volume connection completed successfully. Sep 22 18:34:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-a6675ff3-3754-4ccf-bb97-df1c7409c140 req-8b47bd0d-9999-446c-90cc-9ed113db507b tempest-TestShelveInstance-223188407 None] Deleting attachment a4db4748-7069-4814-a172-04b5b78e37e5. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:34:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a81f0d5f-754d-4e81-8400-27eabf7d58b5 req-f0348e5c-f831-477c-aab1-d75158fd67c1 tempest-TestShelveInstance-223188407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:34:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a81f0d5f-754d-4e81-8400-27eabf7d58b5 req-f0348e5c-f831-477c-aab1-d75158fd67c1 tempest-TestShelveInstance-223188407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:34:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-a81f0d5f-754d-4e81-8400-27eabf7d58b5 req-f0348e5c-f831-477c-aab1-d75158fd67c1 tempest-TestShelveInstance-223188407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:34:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-a81f0d5f-754d-4e81-8400-27eabf7d58b5 req-f0348e5c-f831-477c-aab1-d75158fd67c1 tempest-TestShelveInstance-223188407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-f92b5101-96a7-4a62-a31d-565d33ca0da9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40511d16-72c2-49b8-83a9-17074341632a', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:34:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-a81f0d5f-754d-4e81-8400-27eabf7d58b5 req-f0348e5c-f831-477c-aab1-d75158fd67c1 tempest-TestShelveInstance-223188407 None] attachment_update completed successfully. Sep 22 18:34:47 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:34:48 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:34:48 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:34:48 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.260s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:34:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:34:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:35:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-57301270-6a8e-449f-b8bc-cf1d83f5c67f tempest-TestShelveInstance-223188407 None] Terminate volume connection completed successfully. Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-57301270-6a8e-449f-b8bc-cf1d83f5c67f tempest-TestShelveInstance-223188407 None] Deleting attachment 40511d16-72c2-49b8-83a9-17074341632a. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Acquiring lock "cinder-f92b5101-96a7-4a62-a31d-565d33ca0da9-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "cinder-f92b5101-96a7-4a62-a31d-565d33ca0da9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Acquiring lock "cinder-quobyte-f92b5101-96a7-4a62-a31d-565d33ca0da9" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "cinder-quobyte-f92b5101-96a7-4a62-a31d-565d33ca0da9" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55bfc36-d1e2-4f5d-8f01-89adc1a6fee1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:35:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:06 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 Sep 22 18:35:06 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:07 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9" returned: 0 in 0.371s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:07 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9 Sep 22 18:35:07 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:07 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f92b5101-96a7-4a62-a31d-565d33ca0da9" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "cinder-quobyte-f92b5101-96a7-4a62-a31d-565d33ca0da9" released by "delete_volume" :: held 0.658s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.quota [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Created reservations ['93dbc9e1-0e99-4970-9de2-ddab0680066e', '8176b0a9-a8ff-4454-81af-0c37a46dc235', 'f70c28be-0bdf-4ac2-b589-f2845d2b26f9', '4f72a292-f38f-4d83-94bd-1bb3cf05bd50'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:07 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:35:07 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:07 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.manager [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:35:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Deleted volume successfully. Sep 22 18:35:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [req-7244bd9e-a28c-4707-bd02-8f89130b6d1b req-5fe9adea-28bb-44ff-afdc-7cf7480a9b78 tempest-TestShelveInstance-223188407 None] Lock "cinder-f92b5101-96a7-4a62-a31d-565d33ca0da9-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:35:17 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:35:17 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Flow 'volume_create_manager' (48750e0a-485c-408f-bf2c-99ec8e4b19f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2235c7a0-4b66-475f-b47a-61d1154fe3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2235c7a0-4b66-475f-b47a-61d1154fe3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1368330770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e621d3-f056-4eaa-894c-97a1bf5d54b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8aa925deee43418a40a2e5662eb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:35:38Z,use_quota=True,user_id='abd7b764c8304f33ac8538eb63734acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fbd2d2-4158-427f-93e8-29148f4d5f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fbd2d2-4158-427f-93e8-29148f4d5f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6aed21-cdc5-4249-a698-835e1023ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6aed21-cdc5-4249-a698-835e1023ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e621d3-f056-4eaa-894c-97a1bf5d54b1', 'volume_name': 'volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1555a827-ce75-4e19-a7ef-5365b27d9a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1555a827-ce75-4e19-a7ef-5365b27d9a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef411c6-5162-404d-be96-750f37539973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:38 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Volume 67e621d3-f056-4eaa-894c-97a1bf5d54b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1', 'volume_size': 1} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1368330770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e621d3-f056-4eaa-894c-97a1bf5d54b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8aa925deee43418a40a2e5662eb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:35:38Z,use_quota=True,user_id='abd7b764c8304f33ac8538eb63734acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Creating volume 67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:35:38 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:38 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 1073741824 Sep 22 18:35:38 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:38 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 1073741824" returned: 0 in 0.454s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:38 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:35:38 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:39 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef411c6-5162-404d-be96-750f37539973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde6a0dc-d30d-4666-b7c8-09ccd16fe16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:35:39 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Volume volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 (67e621d3-f056-4eaa-894c-97a1bf5d54b1): created successfully Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde6a0dc-d30d-4666-b7c8-09ccd16fe16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:35:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Flow 'volume_create_manager' (48750e0a-485c-408f-bf2c-99ec8e4b19f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:35:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aca06cf5-d3c1-4907-a146-25626006057b tempest-TestStampPattern-1407361022 None] Created volume successfully. Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:35:48 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:35:48 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:35:48 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:35:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:35:49 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:35:49 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:36:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e3519976-fb8b-4d66-a3e3-1b2284e3bf94 req-030d0e67-4f28-498e-9ef6-4a8678debf2c tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e3519976-fb8b-4d66-a3e3-1b2284e3bf94 req-030d0e67-4f28-498e-9ef6-4a8678debf2c tempest-TestStampPattern-1407361022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-e3519976-fb8b-4d66-a3e3-1b2284e3bf94 req-030d0e67-4f28-498e-9ef6-4a8678debf2c tempest-TestStampPattern-1407361022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-e3519976-fb8b-4d66-a3e3-1b2284e3bf94 req-030d0e67-4f28-498e-9ef6-4a8678debf2c tempest-TestStampPattern-1407361022 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef4e31ff-3443-475b-a5f6-c9aa93305316', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:36:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-e3519976-fb8b-4d66-a3e3-1b2284e3bf94 req-030d0e67-4f28-498e-9ef6-4a8678debf2c tempest-TestStampPattern-1407361022 None] attachment_update completed successfully. Sep 22 18:36:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-f216c229-cdb2-48c5-ad3a-7f0de01870a7 req-b2dba5bc-c614-49e9-843f-02617a237623 tempest-TestStampPattern-1407361022 None] Terminate volume connection completed successfully. Sep 22 18:36:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-f216c229-cdb2-48c5-ad3a-7f0de01870a7 req-b2dba5bc-c614-49e9-843f-02617a237623 tempest-TestStampPattern-1407361022 None] Deleting attachment ef4e31ff-3443-475b-a5f6-c9aa93305316. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:36:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Creating offline snapshot e2cb0833-2844-46f0-a9d6-a2b588112195 of volume 67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:36:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a84f408-c2d5-469f-9ce9-95635fa12f4d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:36:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:13 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:36:13 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:13 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.342s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:13 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 1G Sep 22 18:36:13 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:13 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 1G" returned: 0 in 0.366s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:13 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:36:13 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:13 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.269s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:13 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 is being set with open permissions: ugo+rw Sep 22 18:36:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:13 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:36:13 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:14 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.223s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:14 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info Sep 22 18:36:14 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:14 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:14 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info is being set with open permissions: ugo+rw Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:14 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info Sep 22 18:36:14 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:14 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.info" returned: 0 in 0.230s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.755s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1c614bc7-d9ef-43ea-bb0d-1fcc8ebfefe2 tempest-TestStampPattern-1407361022 None] Create snapshot completed successfully Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Flow 'volume_create_manager' (fe665bdf-8deb-408d-9f4a-d3786b8d9a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880c1b5c-3025-49fa-be85-e838c9377f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880c1b5c-3025-49fa-be85-e838c9377f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-607328355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f192abda-e3dd-42d6-9e3e-ec9fa55d6816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8aa925deee43418a40a2e5662eb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2cb0833-2844-46f0-a9d6-a2b588112195,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:36:21Z,use_quota=True,user_id='abd7b764c8304f33ac8538eb63734acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc6b667-24d3-4feb-9d84-e2b80eff50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc6b667-24d3-4feb-9d84-e2b80eff50df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f4b60c-e810-4575-8870-8ae88c72b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f4b60c-e810-4575-8870-8ae88c72b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f192abda-e3dd-42d6-9e3e-ec9fa55d6816', 'volume_name': 'volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816', 'volume_size': 1, 'snapshot_id': 'e2cb0833-2844-46f0-a9d6-a2b588112195'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b7c95-c286-41d0-bf8b-09810748b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439b7c95-c286-41d0-bf8b-09810748b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9cc271-2166-4400-8591-a29acda2c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:21 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Volume f192abda-e3dd-42d6-9e3e-ec9fa55d6816: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816', 'volume_size': 1, 'snapshot_id': 'e2cb0833-2844-46f0-a9d6-a2b588112195'} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Creating volume f192abda-e3dd-42d6-9e3e-ec9fa55d6816 from snapshot e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] snapshot: e2cb0833-2844-46f0-a9d6-a2b588112195, volume: f192abda-e3dd-42d6-9e3e-ec9fa55d6816, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5d865-508c-40a4-b4e1-cac270560227]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:36:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:21 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:36:21 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:22 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd0e45-12fa-4283-af79-baff1f85ee90]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:22 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:36:22 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:22 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.405s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:36:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:22 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 Sep 22 18:36:22 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:31 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" returned: 0 in 8.768s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:36:31 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Converted 1024.00 MB image at 116.73 MB/s Sep 22 18:36:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 is being set with open permissions: ugo+rw Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:31 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 Sep 22 18:36:31 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:31 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" returned: 0 in 0.282s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" released by "_copy_volume_from_snapshot" :: held 9.940s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" released by "_create_volume_from_snapshot" :: held 10.012s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.028s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9cc271-2166-4400-8591-a29acda2c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816', 'volume_size': 1, 'snapshot_id': 'e2cb0833-2844-46f0-a9d6-a2b588112195'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e726a064-1504-469d-84a9-13343768bcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:36:31 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Volume volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 (f192abda-e3dd-42d6-9e3e-ec9fa55d6816): created successfully Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e726a064-1504-469d-84a9-13343768bcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:36:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Flow 'volume_create_manager' (fe665bdf-8deb-408d-9f4a-d3786b8d9a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:36:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a3efefb2-71ad-4080-bb42-f6e94c194532 tempest-TestStampPattern-1407361022 None] Created volume successfully. Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:36:48 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:36:48 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:36:48 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.240s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:36:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:36:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:36:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:36:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3c8b565f-90dd-46ea-a8fd-302f9fafb06d req-b0096618-0153-47fd-8c20-ad2696b50fd3 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:36:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3c8b565f-90dd-46ea-a8fd-302f9fafb06d req-b0096618-0153-47fd-8c20-ad2696b50fd3 tempest-TestStampPattern-1407361022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:36:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [req-3c8b565f-90dd-46ea-a8fd-302f9fafb06d req-b0096618-0153-47fd-8c20-ad2696b50fd3 tempest-TestStampPattern-1407361022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:36:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-3c8b565f-90dd-46ea-a8fd-302f9fafb06d req-b0096618-0153-47fd-8c20-ad2696b50fd3 tempest-TestStampPattern-1407361022 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4', 'name': 'volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4305890-90ce-4b37-8059-2d77c9c5eed8', 'enforce_multipath': True} {{(pid=86046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 22 18:36:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-3c8b565f-90dd-46ea-a8fd-302f9fafb06d req-b0096618-0153-47fd-8c20-ad2696b50fd3 tempest-TestStampPattern-1407361022 None] attachment_update completed successfully. Sep 22 18:37:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [req-8d527803-d9b4-419a-9288-98b5f2c60baa req-91b9f34c-2ff0-4adb-bd2d-ef99590fd972 tempest-TestStampPattern-1407361022 None] Terminate volume connection completed successfully. Sep 22 18:37:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [req-8d527803-d9b4-419a-9288-98b5f2c60baa req-91b9f34c-2ff0-4adb-bd2d-ef99590fd972 tempest-TestStampPattern-1407361022 None] Deleting attachment f4305890-90ce-4b37-8059-2d77c9c5eed8. {{(pid=86046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-f192abda-e3dd-42d6-9e3e-ec9fa55d6816-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "cinder-f192abda-e3dd-42d6-9e3e-ec9fa55d6816-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7e9a10-8911-4517-baaa-014394ca1c26]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:05 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 Sep 22 18:37:05 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:05 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" returned: 0 in 0.369s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:05 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816 Sep 22 18:37:05 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:05 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-f192abda-e3dd-42d6-9e3e-ec9fa55d6816" released by "delete_volume" :: held 0.659s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Created reservations ['85d2aeb5-52fc-4b21-aa0e-014bd750a7f2', 'c0123242-2e35-4551-9474-df99517ad551', '22d52ed7-52da-4ef9-b5c9-31d276edfdb7', '7a1e2897-8dea-414f-8f2b-c46145547fde'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:05 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:05 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:05 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Deleted volume successfully. Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e5e38fe-37f4-4095-831d-71329fb1a97b tempest-TestStampPattern-1407361022 None] Lock "cinder-f192abda-e3dd-42d6-9e3e-ec9fa55d6816-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-e2cb0833-2844-46f0-a9d6-a2b588112195-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-e2cb0833-2844-46f0-a9d6-a2b588112195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Deleting offline snapshot e2cb0833-2844-46f0-a9d6-a2b588112195 of volume 67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] snapshot_file for this snap is: volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47535e4-fc3d-478e-9695-65682fb365ed]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:06 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:37:06 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:06 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.363s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e9489-44ad-4628-966a-ba4fb8c83107]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:06 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:37:06 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:07 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.515s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:07 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:37:07 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:07 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.330s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:07 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195 Sep 22 18:37:07 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:07 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1.e2cb0833-2844-46f0-a9d6-a2b588112195" returned: 0 in 0.246s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-e2cb0833-2844-46f0-a9d6-a2b588112195" released by "_delete_snapshot" :: held 1.556s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" released by "delete_snapshot" :: held 1.577s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:07 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Created reservations ['f8a5a651-2981-4af4-97ef-104ed5a5ccef', '2daf6446-c7f1-4e25-a5b0-28e7cb1f622c', '9ace69d4-b2cf-4a71-b0a2-abbcde2cecc1', 'ae65de01-8d6f-4559-b13a-bc1ed80860e5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Delete snapshot completed successfully. Sep 22 18:37:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7bef95b5-de46-41ed-a881-bccbd88ade93 tempest-TestStampPattern-1407361022 None] Lock "cinder-e2cb0833-2844-46f0-a9d6-a2b588112195-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-67e621d3-f056-4eaa-894c-97a1bf5d54b1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "cinder-67e621d3-f056-4eaa-894c-97a1bf5d54b1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Acquiring lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecdec6c-bb0c-4e99-8d8d-da721f365648]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:12 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:37:12 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:12 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.343s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:12 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1 Sep 22 18:37:12 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:12 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-67e621d3-f056-4eaa-894c-97a1bf5d54b1" returned: 0 in 0.255s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "cinder-quobyte-67e621d3-f056-4eaa-894c-97a1bf5d54b1" released by "delete_volume" :: held 0.664s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Created reservations ['f1e7bfdb-9ca4-4ee2-a0e3-f6b199f4f668', 'c79273c4-dbd1-4917-878c-0d68d9a96dc3', '80499c47-f665-4ad7-8a4e-972805a1d402', '1ef32a76-83ea-4ecd-9f3c-6dd0ee0b04bf'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:12 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:12 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:13 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.236s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:13 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Deleted volume successfully. Sep 22 18:37:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9e639d66-99b9-4abb-9ca1-8fbcac4b1143 tempest-TestStampPattern-1407361022 None] Lock "cinder-67e621d3-f056-4eaa-894c-97a1bf5d54b1-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:22 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:37:23 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Flow 'volume_create_manager' (c475d32f-b3c3-40e9-b987-96a65eed2db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3544d24-1981-48f1-8bfe-16e397a7a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3544d24-1981-48f1-8bfe-16e397a7a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2028184610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af789a25-5226-4240-9a63-2836260b8dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0519aa33ad4c0e8ed9033fa7300dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:25Z,use_quota=True,user_id='e79e6c59c07a49ad936296ec4cc10bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f60d4ac-4a7f-43f8-a24d-0fb2efd73a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f60d4ac-4a7f-43f8-a24d-0fb2efd73a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d22d06c-f1c2-4f71-a499-2451fd497378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d22d06c-f1c2-4f71-a499-2451fd497378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af789a25-5226-4240-9a63-2836260b8dab', 'volume_name': 'volume-af789a25-5226-4240-9a63-2836260b8dab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf033d7-2c84-491e-9bbd-b4ff5c92d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf033d7-2c84-491e-9bbd-b4ff5c92d0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7332095d-3121-4d6d-bc6c-a40945e149aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:24 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Volume af789a25-5226-4240-9a63-2836260b8dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af789a25-5226-4240-9a63-2836260b8dab', 'volume_size': 1} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2028184610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af789a25-5226-4240-9a63-2836260b8dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0519aa33ad4c0e8ed9033fa7300dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:25Z,use_quota=True,user_id='e79e6c59c07a49ad936296ec4cc10bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Creating volume af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:37:24 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:37:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:24 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab 1073741824 Sep 22 18:37:24 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:25 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab 1073741824" returned: 0 in 0.403s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:25 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:25 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:25 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7332095d-3121-4d6d-bc6c-a40945e149aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af789a25-5226-4240-9a63-2836260b8dab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5e14c2-8bb2-4977-9cd0-e464b90db776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Volume volume-af789a25-5226-4240-9a63-2836260b8dab (af789a25-5226-4240-9a63-2836260b8dab): created successfully Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5e14c2-8bb2-4977-9cd0-e464b90db776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Flow 'volume_create_manager' (c475d32f-b3c3-40e9-b987-96a65eed2db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7a221848-b7be-429c-ab51-d01394b628c0 tempest-VolumeDependencyTests-344402903 None] Created volume successfully. Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Creating offline snapshot 16237aed-6bc9-4a12-a81e-35aa6bba529c of volume af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a642f-64bf-448e-a7b2-397532f1bf5c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:25 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:25 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:26 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:26 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c 1G Sep 22 18:37:26 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:26 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c 1G" returned: 0 in 0.377s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af789a25-5226-4240-9a63-2836260b8dab -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:26 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af789a25-5226-4240-9a63-2836260b8dab -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:26 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:26 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af789a25-5226-4240-9a63-2836260b8dab -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:26 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c is being set with open permissions: ugo+rw Sep 22 18:37:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:26 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:26 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:27 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:27 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info Sep 22 18:37:27 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:27 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:27 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info is being set with open permissions: ugo+rw Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:27 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info Sep 22 18:37:27 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:27 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.info" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:27 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b52820d5-30d0-4a82-9d9c-c9570f848f6c tempest-VolumeDependencyTests-344402903 None] Create snapshot completed successfully Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Flow 'volume_create_manager' (dbec2cbb-1b54-4aa0-a9eb-09219c62e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc815030-32d0-4042-a8ca-4950d74b78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc815030-32d0-4042-a8ca-4950d74b78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-675309752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2da838-181f-4a44-ab08-3740d5972696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0519aa33ad4c0e8ed9033fa7300dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16237aed-6bc9-4a12-a81e-35aa6bba529c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:28Z,use_quota=True,user_id='e79e6c59c07a49ad936296ec4cc10bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2efe8c-a335-42dd-b462-567d1ec2120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2efe8c-a335-42dd-b462-567d1ec2120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6730a4a9-b696-4c86-8a5c-8cb1687aca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6730a4a9-b696-4c86-8a5c-8cb1687aca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d2da838-181f-4a44-ab08-3740d5972696', 'volume_name': 'volume-8d2da838-181f-4a44-ab08-3740d5972696', 'volume_size': 1, 'snapshot_id': '16237aed-6bc9-4a12-a81e-35aa6bba529c'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce05d7f-9d9a-4857-8682-120f2b7f26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce05d7f-9d9a-4857-8682-120f2b7f26bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48ea7d-39c7-4bcd-9aad-24e78187e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Volume 8d2da838-181f-4a44-ab08-3740d5972696: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d2da838-181f-4a44-ab08-3740d5972696', 'volume_size': 1, 'snapshot_id': '16237aed-6bc9-4a12-a81e-35aa6bba529c'} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c-8d2da838-181f-4a44-ab08-3740d5972696" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c-8d2da838-181f-4a44-ab08-3740d5972696" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Creating volume 8d2da838-181f-4a44-ab08-3740d5972696 from snapshot 16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] snapshot: 16237aed-6bc9-4a12-a81e-35aa6bba529c, volume: 8d2da838-181f-4a44-ab08-3740d5972696, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df57d1-8fce-45a7-ab13-66092d1e956d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:28 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:28 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:28 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af789a25-5226-4240-9a63-2836260b8dab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6d065-909a-4565-81bc-d8803f9562fe]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:28 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:28 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:29 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.336s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:37:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:37:29 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:37:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:29 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 Sep 22 18:37:29 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:34 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696" returned: 0 in 5.618s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:34 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:37:34 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Converted 1024.00 MB image at 182.22 MB/s Sep 22 18:37:34 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 is being set with open permissions: ugo+rw Sep 22 18:37:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:34 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 Sep 22 18:37:34 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:34 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" released by "_copy_volume_from_snapshot" :: held 6.598s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c-8d2da838-181f-4a44-ab08-3740d5972696" released by "_create_volume_from_snapshot" :: held 6.659s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.672s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f48ea7d-39c7-4bcd-9aad-24e78187e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2da838-181f-4a44-ab08-3740d5972696', 'volume_size': 1, 'snapshot_id': '16237aed-6bc9-4a12-a81e-35aa6bba529c'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00700c66-b18a-4f7e-a8d8-54c90e96ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:35 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Volume volume-8d2da838-181f-4a44-ab08-3740d5972696 (8d2da838-181f-4a44-ab08-3740d5972696): created successfully Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00700c66-b18a-4f7e-a8d8-54c90e96ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Flow 'volume_create_manager' (dbec2cbb-1b54-4aa0-a9eb-09219c62e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bf62f951-3917-40fb-b30c-c118e01a3915 tempest-VolumeDependencyTests-344402903 None] Created volume successfully. Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-16237aed-6bc9-4a12-a81e-35aa6bba529c-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-16237aed-6bc9-4a12-a81e-35aa6bba529c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Deleting offline snapshot 16237aed-6bc9-4a12-a81e-35aa6bba529c of volume af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] snapshot_file for this snap is: volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4dac5-039b-4856-ad7e-67eaef029359]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:35 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:35 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:36 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af789a25-5226-4240-9a63-2836260b8dab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2909f3-8ecf-414c-a208-9b5940e242f6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:36 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:36 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:36 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.501s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:36 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:36 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:37 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.332s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:37 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c Sep 22 18:37:37 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:37 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab.16237aed-6bc9-4a12-a81e-35aa6bba529c" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-16237aed-6bc9-4a12-a81e-35aa6bba529c" released by "_delete_snapshot" :: held 1.546s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" released by "delete_snapshot" :: held 1.566s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Created reservations ['fb91a755-89f3-49db-b018-a1b5682f57fd', 'b70d3058-ef42-4970-a5c1-c6ac804681fb', '701a8e43-7d62-4845-b628-c205c402eb2d', '85190eeb-1c96-40a6-ac42-b98b1db40f01'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Delete snapshot completed successfully. Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90e32389-cd98-4455-a0cc-c4ef5a433274 tempest-VolumeDependencyTests-344402903 None] Lock "cinder-16237aed-6bc9-4a12-a81e-35aa6bba529c-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-af789a25-5226-4240-9a63-2836260b8dab-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "cinder-af789a25-5226-4240-9a63-2836260b8dab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" acquired by "delete_volume" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf869a9-68b0-4875-aac2-e41d1543f9fd]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:38 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:38 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:38 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.352s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:38 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab Sep 22 18:37:38 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:38 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-af789a25-5226-4240-9a63-2836260b8dab" returned: 0 in 0.233s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-af789a25-5226-4240-9a63-2836260b8dab" released by "delete_volume" :: held 0.644s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Created reservations ['cc62684d-0236-404b-a46d-11b5c0fc9edc', 'ace9a62c-8869-4a4a-910f-eb35fdbce5f5', '215f1caa-6f0b-484c-956a-5c883315428e', 'edf39ffe-edfd-4cad-beb5-30044de1a818'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:38 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:38 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:39 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Deleted volume successfully. Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d7d86d24-7b25-4a73-a7c8-8b15588764df tempest-VolumeDependencyTests-344402903 None] Lock "cinder-af789a25-5226-4240-9a63-2836260b8dab-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-8d2da838-181f-4a44-ab08-3740d5972696-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "cinder-8d2da838-181f-4a44-ab08-3740d5972696-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Acquiring lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64cba04-9147-4c35-a49a-196d2afa5541]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:39 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 Sep 22 18:37:39 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:39 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696" returned: 0 in 0.344s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:39 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696 Sep 22 18:37:39 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:39 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8d2da838-181f-4a44-ab08-3740d5972696" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "cinder-quobyte-8d2da838-181f-4a44-ab08-3740d5972696" released by "delete_volume" :: held 0.614s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Created reservations ['d3a009f7-cedd-4e1d-a41c-7ef6d169f4fd', '49ff91c0-b211-4c4c-97b6-289027c75170', '12944f67-550c-4e3f-b329-b446a0627fab', '7aae877e-f9ca-4b6e-9b80-9486517430d4'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:39 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:39 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:40 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:40 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Deleted volume successfully. Sep 22 18:37:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4e52f731-f70e-4693-995c-d708c70923fc tempest-VolumeDependencyTests-344402903 None] Lock "cinder-8d2da838-181f-4a44-ab08-3740d5972696-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Flow 'volume_create_manager' (da5aa3d4-7308-4b57-aa5f-fd3293702701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812a36e-2472-415a-9885-b91dab2dfadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812a36e-2472-415a-9885-b91dab2dfadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1584e4e-77ff-415b-94e5-113f8b845e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ac0b29ca4c493a8146073c135638cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:45Z,use_quota=True,user_id='d17e6d6ba1d34d7898289a4f401a3123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9cbfd7-1041-49c5-ba4a-65d42ba5a587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9cbfd7-1041-49c5-ba4a-65d42ba5a587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631ac74d-69fd-4d89-b05a-79582c711fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631ac74d-69fd-4d89-b05a-79582c711fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1584e4e-77ff-415b-94e5-113f8b845e81', 'volume_name': 'volume-a1584e4e-77ff-415b-94e5-113f8b845e81', 'volume_size': 1, 'image_id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aa38a9a3d4e0bd971256265a7163e2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57ac0b29ca4c493a8146073c135638cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e750f7ef6ea6395aa8e53dfafca4cbd63d62014bf019d7423763fa51cf3ec9f737c4e03cead5ab27b43ecda789c30225842d9387b9e99699292c27b07fd9ff0', 'id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'created_at': datetime.datetime(2026, 9, 22, 16, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b4c06d-4786-4fe1-9b21-5c4a680335e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b4c06d-4786-4fe1-9b21-5c4a680335e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af550fd-aa7a-4795-855e-aace1c7f4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:45 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Volume a1584e4e-77ff-415b-94e5-113f8b845e81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1584e4e-77ff-415b-94e5-113f8b845e81', 'volume_size': 1, 'image_id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aa38a9a3d4e0bd971256265a7163e2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57ac0b29ca4c493a8146073c135638cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e750f7ef6ea6395aa8e53dfafca4cbd63d62014bf019d7423763fa51cf3ec9f737c4e03cead5ab27b43ecda789c30225842d9387b9e99699292c27b07fd9ff0', 'id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'created_at': datetime.datetime(2026, 9, 22, 16, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437/file', 'properties': {}}, 'image_service': } Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Trying to clone a1584e4e-77ff-415b-94e5-113f8b845e81 from image ab2c04c5-d5cd-46e3-acd5-652afc42a437 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:37:45 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Image download 0.00 MB at 0.00 MB/s Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[78962784-94af-4384-a364-84463a9b93e4]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:45 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:45 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:45 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:45 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:45 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:46 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 1 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Temporary image ab2c04c5-d5cd-46e3-acd5-652afc42a437 is fetched for user d17e6d6ba1d34d7898289a4f401a3123. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c945d2-cbef-4016-b14a-60278a77c9c1]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:46 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:46 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:46 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:46 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:46 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:46 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 1 in 0.298s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1584e4e-77ff-415b-94e5-113f8b845e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ac0b29ca4c493a8146073c135638cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:45Z,use_quota=True,user_id='d17e6d6ba1d34d7898289a4f401a3123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Creating volume a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:37:46 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:37:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:46 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1073741824 Sep 22 18:37:46 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:47 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1073741824" returned: 0 in 0.405s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:47 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 Sep 22 18:37:47 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:47 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81" returned: 0 in 0.236s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Attempting download of ab2c04c5-d5cd-46e3-acd5-652afc42a437 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}])) to volume a1584e4e-77ff-415b-94e5-113f8b845e81. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[721482c1-79d3-4541-8ca0-234a3d3fe3c0]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:47 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn Sep 22 18:37:47 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:47 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn" returned: 0 in 0.310s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:47 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn Sep 22 18:37:47 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:48 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn" returned: 1 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab2c04c5-d5cd-46e3-acd5-652afc42a437_491ijefn' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4f71e-59d6-4fc8-b0b7-2110c56286f1]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:48 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:48 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:48 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:48 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD Sep 22 18:37:48 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:48 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:48 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:48 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD" returned: 1 in 0.305s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] ab2c04c5-d5cd-46e3-acd5-652afc42a437 was raw, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:48 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 Sep 22 18:37:48 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:48 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:37:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:37:49 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81" returned: 0 in 0.429s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab2c04c5-d5cd-46e3-acd5-652afc42a437_d1nzp6q5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:37:49 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:49 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1G Sep 22 18:37:49 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:49 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 1G" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Downloaded image ab2c04c5-d5cd-46e3-acd5-652afc42a437 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}])) to volume a1584e4e-77ff-415b-94e5-113f8b845e81 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Temporary image ab2c04c5-d5cd-46e3-acd5-652afc42a437 for user d17e6d6ba1d34d7898289a4f401a3123 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Marking volume a1584e4e-77ff-415b-94e5-113f8b845e81 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Copying metadata from image ab2c04c5-d5cd-46e3-acd5-652afc42a437 to a1584e4e-77ff-415b-94e5-113f8b845e81. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Creating volume glance metadata for volume a1584e4e-77ff-415b-94e5-113f8b845e81 backed by image ab2c04c5-d5cd-46e3-acd5-652afc42a437 with: {'image_id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1aa38a9a3d4e0bd971256265a7163e2f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af550fd-aa7a-4795-855e-aace1c7f4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1584e4e-77ff-415b-94e5-113f8b845e81', 'volume_size': 1, 'image_id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aa38a9a3d4e0bd971256265a7163e2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57ac0b29ca4c493a8146073c135638cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e750f7ef6ea6395aa8e53dfafca4cbd63d62014bf019d7423763fa51cf3ec9f737c4e03cead5ab27b43ecda789c30225842d9387b9e99699292c27b07fd9ff0', 'id': 'ab2c04c5-d5cd-46e3-acd5-652afc42a437', 'created_at': datetime.datetime(2026, 9, 22, 16, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab2c04c5-d5cd-46e3-acd5-652afc42a437/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61170a34-6bb9-4bfb-a56b-832c0378927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:49 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Volume volume-a1584e4e-77ff-415b-94e5-113f8b845e81 (a1584e4e-77ff-415b-94e5-113f8b845e81): created successfully Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61170a34-6bb9-4bfb-a56b-832c0378927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:49 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Flow 'volume_create_manager' (da5aa3d4-7308-4b57-aa5f-fd3293702701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:49 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a82b90b6-e731-41b4-9a6b-f69af3c744e8 tempest-VolumeImageDependencyTests-1032243540 None] Created volume successfully. Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Acquiring lock "cinder-a1584e4e-77ff-415b-94e5-113f8b845e81-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "cinder-a1584e4e-77ff-415b-94e5-113f8b845e81-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Acquiring lock "cinder-quobyte-a1584e4e-77ff-415b-94e5-113f8b845e81" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "cinder-quobyte-a1584e4e-77ff-415b-94e5-113f8b845e81" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb50820b-236f-4759-bbbb-a3ed89ec9200]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:50 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 Sep 22 18:37:50 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:50 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81" returned: 0 in 0.367s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:50 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81 Sep 22 18:37:50 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:51 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a1584e4e-77ff-415b-94e5-113f8b845e81" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "cinder-quobyte-a1584e4e-77ff-415b-94e5-113f8b845e81" released by "delete_volume" :: held 0.679s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Created reservations ['6ec16b12-0a11-4adb-a4a8-6d95ac4f4991', '2edae571-f1f4-4c3a-b893-8ea942c63f54', 'a1e12f49-bd17-4ea9-9720-ab633ecab838', '5b294a6e-2c1d-4b8b-b8b1-76592ed09fab'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:51 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:51 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:51 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Deleted volume successfully. Sep 22 18:37:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d25baa92-f566-4a57-aee8-6d8028e268f5 tempest-VolumeImageDependencyTests-1032243540 None] Lock "cinder-a1584e4e-77ff-415b-94e5-113f8b845e81-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Flow 'volume_create_manager' (35863af4-d5c6-41a8-88df-95c879bfef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa1459-a8c6-4ca2-91a2-7abac18cd1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa1459-a8c6-4ca2-91a2-7abac18cd1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278555334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e61807f-772b-40d8-af67-a7ac8e4dca8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1047d1fd156a455c9452f389b7cc0094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:55Z,use_quota=True,user_id='2d44b970383a48f89081ef9a44e4b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a648727-4aa3-45ef-835d-76676a23358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a648727-4aa3-45ef-835d-76676a23358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d980191f-c354-444d-8cfc-2428258090ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d980191f-c354-444d-8cfc-2428258090ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e61807f-772b-40d8-af67-a7ac8e4dca8c', 'volume_name': 'volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4444443-f000-4a3b-92d2-d4995a1c50e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4444443-f000-4a3b-92d2-d4995a1c50e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fe9875-080a-45e5-95e1-fbbdacbbb83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Volume 5e61807f-772b-40d8-af67-a7ac8e4dca8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c', 'volume_size': 1} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278555334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e61807f-772b-40d8-af67-a7ac8e4dca8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1047d1fd156a455c9452f389b7cc0094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:55Z,use_quota=True,user_id='2d44b970383a48f89081ef9a44e4b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Creating volume 5e61807f-772b-40d8-af67-a7ac8e4dca8c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:37:55 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:55 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c 1073741824 Sep 22 18:37:55 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:55 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c 1073741824" returned: 0 in 0.382s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:55 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c Sep 22 18:37:55 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:55 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c" returned: 0 in 0.235s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fe9875-080a-45e5-95e1-fbbdacbbb83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a1afe-fcd3-4e3a-99b5-86601c552fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Volume volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c (5e61807f-772b-40d8-af67-a7ac8e4dca8c): created successfully Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a1afe-fcd3-4e3a-99b5-86601c552fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Flow 'volume_create_manager' (35863af4-d5c6-41a8-88df-95c879bfef1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:55 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cc2f875b-4225-4e32-a9b5-ad2c588ff273 tempest-ProjectReaderTests-81499354 None] Created volume successfully. Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Acquiring lock "cinder-5e61807f-772b-40d8-af67-a7ac8e4dca8c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "cinder-5e61807f-772b-40d8-af67-a7ac8e4dca8c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Acquiring lock "cinder-quobyte-5e61807f-772b-40d8-af67-a7ac8e4dca8c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "cinder-quobyte-5e61807f-772b-40d8-af67-a7ac8e4dca8c" acquired by "delete_volume" :: waited 0.012s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a28b5-7865-4cab-aca4-dbfe3e017f7a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:56 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c Sep 22 18:37:56 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:56 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:56 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c Sep 22 18:37:56 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:56 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-5e61807f-772b-40d8-af67-a7ac8e4dca8c" returned: 0 in 0.229s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "cinder-quobyte-5e61807f-772b-40d8-af67-a7ac8e4dca8c" released by "delete_volume" :: held 0.603s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Created reservations ['e0796b4b-d3a0-4b9b-9727-c30a969ecb96', '9ccd2940-94ad-4053-a770-b2cd456c591e', '19d99f80-23e8-41e6-9abc-f4f209d6d8ee', 'ac9f1a7f-a2ee-4006-9939-99e4b0baf72d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:57 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:57 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:57 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.229s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Deleted volume successfully. Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-dca1c363-104a-4b07-839b-4934cc9d26bc tempest-ProjectReaderTests-81499354 None] Lock "cinder-5e61807f-772b-40d8-af67-a7ac8e4dca8c-delete_volume" released by "delete_volume" :: held 1.016s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Flow 'volume_create_manager' (a9d48af4-a4bb-4a0f-a2b7-cda251a14305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401e3979-6531-47b4-ad53-00902cad65cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401e3979-6531-47b4-ad53-00902cad65cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208066200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a66da2d-bd2d-4fcf-8074-ef06973c54c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1047d1fd156a455c9452f389b7cc0094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:58Z,use_quota=True,user_id='2d44b970383a48f89081ef9a44e4b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6084e8-3c84-4343-9bf8-9cab932c819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6084e8-3c84-4343-9bf8-9cab932c819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd514b2-0500-41f2-9ac2-b4d02ffc433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd514b2-0500-41f2-9ac2-b4d02ffc433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a66da2d-bd2d-4fcf-8074-ef06973c54c7', 'volume_name': 'volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf71b1f2-d0ba-4100-9f8a-65188cd14732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf71b1f2-d0ba-4100-9f8a-65188cd14732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c0acac-683a-4000-9855-52245270b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:57 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Volume 6a66da2d-bd2d-4fcf-8074-ef06973c54c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7', 'volume_size': 1} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208066200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a66da2d-bd2d-4fcf-8074-ef06973c54c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1047d1fd156a455c9452f389b7cc0094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:37:58Z,use_quota=True,user_id='2d44b970383a48f89081ef9a44e4b94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Creating volume 6a66da2d-bd2d-4fcf-8074-ef06973c54c7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:37:57 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:37:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:57 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 1073741824 Sep 22 18:37:57 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:58 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 1073741824" returned: 0 in 0.455s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:58 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 Sep 22 18:37:58 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:58 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" returned: 0 in 0.246s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c0acac-683a-4000-9855-52245270b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a063dea7-a06e-4602-9141-a21a9596c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:37:58 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Volume volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 (6a66da2d-bd2d-4fcf-8074-ef06973c54c7): created successfully Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a063dea7-a06e-4602-9141-a21a9596c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Flow 'volume_create_manager' (a9d48af4-a4bb-4a0f-a2b7-cda251a14305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:37:58 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b95451d2-4047-44c7-9324-3981676dd4b3 tempest-ProjectReaderTests-81499354 None] Created volume successfully. Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Acquiring lock "cinder-6a66da2d-bd2d-4fcf-8074-ef06973c54c7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "cinder-6a66da2d-bd2d-4fcf-8074-ef06973c54c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Acquiring lock "cinder-quobyte-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "cinder-quobyte-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6d518-f993-4194-9d90-f04314128e53]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:37:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:59 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 Sep 22 18:37:59 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:59 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" returned: 0 in 0.351s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:59 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7 Sep 22 18:37:59 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:59 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" returned: 0 in 0.226s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "cinder-quobyte-6a66da2d-bd2d-4fcf-8074-ef06973c54c7" released by "delete_volume" :: held 0.616s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Created reservations ['56f7494d-c149-4df2-a763-70df3b258206', 'd69b2132-bfb9-4431-8349-6af604dde9fb', '11f372c3-4c84-4611-bb13-b4feb14d3be4', '79692dd1-608e-42f6-8922-1967e7d98b85'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:37:59 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:37:59 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:37:59 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.225s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:37:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Deleted volume successfully. Sep 22 18:37:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0ee165ad-674e-45a8-9c0d-a9d36d36d497 tempest-ProjectReaderTests-81499354 None] Lock "cinder-6a66da2d-bd2d-4fcf-8074-ef06973c54c7-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:09 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=49,cinder:UPDATE=69,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:38:09 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=53,cinder:UPDATE=58,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Flow 'volume_create_manager' (8caf6104-9c7f-425c-9b35-e15249761f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ad53e-19ea-4818-9d90-ddb82d81e868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ad53e-19ea-4818-9d90-ddb82d81e868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-781049665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a90799b-b882-4052-a475-cc3ae4c1fb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970fcaf589243f3b78ba7ac5ba5dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:38:23Z,use_quota=True,user_id='0bcc436572a04c38901a555c8ffdca85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd637f0-145c-42d8-b827-52c642fb2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd637f0-145c-42d8-b827-52c642fb2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5af7b3-e2a9-43a8-a9ea-b974729c759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:22 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5af7b3-e2a9-43a8-a9ea-b974729c759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a90799b-b882-4052-a475-cc3ae4c1fb98', 'volume_name': 'volume-6a90799b-b882-4052-a475-cc3ae4c1fb98', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492ea022-15c6-460e-80e2-c7e71bd62035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492ea022-15c6-460e-80e2-c7e71bd62035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754f2b47-9d72-42a9-9fa2-8af42ce59558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Volume 6a90799b-b882-4052-a475-cc3ae4c1fb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a90799b-b882-4052-a475-cc3ae4c1fb98', 'volume_size': 1} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-781049665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a90799b-b882-4052-a475-cc3ae4c1fb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970fcaf589243f3b78ba7ac5ba5dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:38:23Z,use_quota=True,user_id='0bcc436572a04c38901a555c8ffdca85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Creating volume 6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:38:23 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:23 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 1073741824 Sep 22 18:38:23 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:23 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 1073741824" returned: 0 in 0.413s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:23 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:23 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:23 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754f2b47-9d72-42a9-9fa2-8af42ce59558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a90799b-b882-4052-a475-cc3ae4c1fb98', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e940a77-d6c1-455b-99e7-9d90e7949c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Volume volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 (6a90799b-b882-4052-a475-cc3ae4c1fb98): created successfully Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e940a77-d6c1-455b-99e7-9d90e7949c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Flow 'volume_create_manager' (8caf6104-9c7f-425c-9b35-e15249761f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:38:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8dc3b3eb-3975-43c1-9c6a-f43ba7b2fb30 tempest-SnapshotDependencyTests-1242860693 None] Created volume successfully. Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Creating offline snapshot 471e7dbe-a47f-4da1-89f1-322a61aa36ff of volume 6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7174bbba-891e-4849-9510-eb23e87e2b89]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:24 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:24 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:24 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.352s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:24 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff 1G Sep 22 18:38:24 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:24 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff 1G" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:24 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:24 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:25 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.308s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:25 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff is being set with open permissions: ugo+rw Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:25 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:25 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:25 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:25 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info Sep 22 18:38:25 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:25 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:25 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info is being set with open permissions: ugo+rw Sep 22 18:38:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:25 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info Sep 22 18:38:25 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:26 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.info" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-11da7a0e-f0f6-4aa4-af28-bcec72f73e8f tempest-SnapshotDependencyTests-1242860693 None] Create snapshot completed successfully Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Flow 'volume_create_manager' (831b3c7a-811f-4f68-88dd-35c988f26de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cea330-add7-4805-b12c-1ed42d291115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cea330-add7-4805-b12c-1ed42d291115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5970fcaf589243f3b78ba7ac5ba5dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=471e7dbe-a47f-4da1-89f1-322a61aa36ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:38:27Z,use_quota=True,user_id='0bcc436572a04c38901a555c8ffdca85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c7d9c0-b219-4bea-b3b5-3ccc31377e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c7d9c0-b219-4bea-b3b5-3ccc31377e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea133a2-fb23-4c78-9786-51a8dd8d25d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea133a2-fb23-4c78-9786-51a8dd8d25d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8', 'volume_name': 'volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8', 'volume_size': 1, 'snapshot_id': '471e7dbe-a47f-4da1-89f1-322a61aa36ff'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b67b70-41fc-4924-b2a2-de975938756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b67b70-41fc-4924-b2a2-de975938756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79443479-9b2f-45d4-ba3a-d256936ef672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Volume e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8', 'volume_size': 1, 'snapshot_id': '471e7dbe-a47f-4da1-89f1-322a61aa36ff'} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Creating volume e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 from snapshot 471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:38:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] snapshot: 471e7dbe-a47f-4da1-89f1-322a61aa36ff, volume: e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868e8e4-a29b-44fc-97be-16e9e9d73d26]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:27 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:27 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:27 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a90799b-b882-4052-a475-cc3ae4c1fb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce122ac3-76fd-480e-a860-78462e263e67]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:27 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:27 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:27 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:38:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:27 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 Sep 22 18:38:27 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:33 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" returned: 0 in 5.994s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:33 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:38:33 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Converted 1024.00 MB image at 170.79 MB/s Sep 22 18:38:33 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 is being set with open permissions: ugo+rw Sep 22 18:38:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:33 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 Sep 22 18:38:33 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:34 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" released by "_copy_volume_from_snapshot" :: held 7.087s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" released by "_create_volume_from_snapshot" :: held 7.146s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.162s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79443479-9b2f-45d4-ba3a-d256936ef672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8', 'volume_size': 1, 'snapshot_id': '471e7dbe-a47f-4da1-89f1-322a61aa36ff'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d896e31-c50e-4b02-aee9-34763de9f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:38:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Volume volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 (e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8): created successfully Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d896e31-c50e-4b02-aee9-34763de9f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Flow 'volume_create_manager' (831b3c7a-811f-4f68-88dd-35c988f26de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:38:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7b012653-2df3-47c0-b810-07d3be77f3a1 tempest-SnapshotDependencyTests-1242860693 None] Created volume successfully. Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-471e7dbe-a47f-4da1-89f1-322a61aa36ff-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-471e7dbe-a47f-4da1-89f1-322a61aa36ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Deleting offline snapshot 471e7dbe-a47f-4da1-89f1-322a61aa36ff of volume 6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] snapshot_file for this snap is: volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7425d0-876f-49a3-ad92-60b08ba85896]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:34 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:34 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:34 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a90799b-b882-4052-a475-cc3ae4c1fb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b73368-a2f4-4687-a495-119abf8bc7f0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:35 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:35 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:35 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.524s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:35 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:35 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:35 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:35 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff Sep 22 18:38:35 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:35 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98.471e7dbe-a47f-4da1-89f1-322a61aa36ff" returned: 0 in 0.228s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-471e7dbe-a47f-4da1-89f1-322a61aa36ff" released by "_delete_snapshot" :: held 1.503s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" released by "delete_snapshot" :: held 1.523s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Created reservations ['6483439b-0363-4f2a-89d6-46b39b735fa5', '4a0884e8-5b9d-4547-bdb9-f7e126722aa5', '927f0063-acf5-4a82-b5ae-965dcb8df5a9', '3cf18a66-af2e-42a8-a8f7-99d3d0942f0f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:38:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Delete snapshot completed successfully. Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-8fc9f65e-491f-4b0c-9e6b-808f47b7cd44 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-471e7dbe-a47f-4da1-89f1-322a61aa36ff-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-6a90799b-b882-4052-a475-cc3ae4c1fb98-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-6a90799b-b882-4052-a475-cc3ae4c1fb98-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2833691-2019-4ced-aaee-3e32e92d55a9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:36 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:36 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:37 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.339s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:37 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98 Sep 22 18:38:37 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:37 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6a90799b-b882-4052-a475-cc3ae4c1fb98" returned: 0 in 0.227s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-6a90799b-b882-4052-a475-cc3ae4c1fb98" released by "delete_volume" :: held 0.626s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Created reservations ['b523f79a-bae5-497b-a27a-104552b55766', '81d29724-b890-4d0a-bbf6-90149979ef69', '869f4b2e-d147-477a-9250-7d23b8f43e80', '2a2f3267-dbe3-4d91-9ffd-c57af0bc3c18'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:37 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:38:37 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:37 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.229s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:38:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Deleted volume successfully. Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-10407c57-2a67-45f1-a493-1a298fbf08c2 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-6a90799b-b882-4052-a475-cc3ae4c1fb98-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2afd3-7ed4-4c8b-9c53-2b39ac0fcdef]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:38:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:37 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 Sep 22 18:38:37 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:38 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:38 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8 Sep 22 18:38:38 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:38 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-quobyte-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8" released by "delete_volume" :: held 0.624s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Created reservations ['09ea0b3a-3c32-4983-aed2-f5dece2e57a4', '3b9b651e-f5b6-46bc-a950-874c1d572e50', '3b944815-3954-4761-9cd5-fd664ce4d2b0', '2d724aa1-f8c3-4eee-98f3-b54a5b1a42c7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:38 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:38:38 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:38 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:38:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Deleted volume successfully. Sep 22 18:38:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-24435b37-4963-47e4-a1ae-57fac7df3ed9 tempest-SnapshotDependencyTests-1242860693 None] Lock "cinder-e491a31a-e31c-4fab-9bd7-cbeee8ecf6f8-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:38:48 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:38:48 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:38:48 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:38:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:38:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=19,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:38:50 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=26,cinder:SELECT=31,cinder:DELETE=1,cinder:INSERT=6 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (a29634f2-391b-4077-a97a-b9a644ab8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554aa24-ce31-4fef-9206-48caffda289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5554aa24-ce31-4fef-9206-48caffda289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001966239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb74935e-d807-4823-847e-af1e019500a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:00Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a022b76-e28a-4ed3-8c8b-76e77e42af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a022b76-e28a-4ed3-8c8b-76e77e42af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a083855a-1bcc-4e3d-aba3-fa22c430c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a083855a-1bcc-4e3d-aba3-fa22c430c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb74935e-d807-4823-847e-af1e019500a2', 'volume_name': 'volume-bb74935e-d807-4823-847e-af1e019500a2', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2543000-cb58-44d1-ae49-49578ce6eb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2543000-cb58-44d1-ae49-49578ce6eb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44bc96f-f307-4767-81c5-2e6f60e8611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Volume bb74935e-d807-4823-847e-af1e019500a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb74935e-d807-4823-847e-af1e019500a2', 'volume_size': 1} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001966239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb74935e-d807-4823-847e-af1e019500a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:00Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Creating volume bb74935e-d807-4823-847e-af1e019500a2 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:00 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:00 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 1073741824 Sep 22 18:39:00 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (ebfbdf2d-fc42-4a19-975a-7cf818c55148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d9f1f8-9e87-4fec-8acd-3e8bd61a9f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d9f1f8-9e87-4fec-8acd-3e8bd61a9f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334095580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2847a9d-5b19-488d-99e3-fca24202be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f252c99-f242-41cc-82f2-172bf5ab7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f252c99-f242-41cc-82f2-172bf5ab7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7b2fff-257d-402d-a496-72bdd148461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7b2fff-257d-402d-a496-72bdd148461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2847a9d-5b19-488d-99e3-fca24202be5c', 'volume_name': 'volume-c2847a9d-5b19-488d-99e3-fca24202be5c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30301d6c-a906-401f-aeff-12a8edc961bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30301d6c-a906-401f-aeff-12a8edc961bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5f0438-275e-4406-9c6f-104882d6fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:00 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Volume c2847a9d-5b19-488d-99e3-fca24202be5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2847a9d-5b19-488d-99e3-fca24202be5c', 'volume_size': 1} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 1073741824" returned: 0 in 0.729s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (e7864271-0fe1-4b71-9670-3c77dc5043d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:00 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4364fa-d332-4d3d-b62b-cb51ecdf6ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4364fa-d332-4d3d-b62b-cb51ecdf6ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-657943711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de23ee1-6821-49df-8abb-0e47396330c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed42ddd-16f9-4554-88a9-e6571af7907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed42ddd-16f9-4554-88a9-e6571af7907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d95264-c0a1-4afa-aa26-92acc6aaee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d95264-c0a1-4afa-aa26-92acc6aaee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de23ee1-6821-49df-8abb-0e47396330c4', 'volume_name': 'volume-7de23ee1-6821-49df-8abb-0e47396330c4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cd2237-b0f2-4e89-976f-55c1c53c36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cd2237-b0f2-4e89-976f-55c1c53c36db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89448fc4-a83b-4b9a-946b-da55cbe1061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume 7de23ee1-6821-49df-8abb-0e47396330c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de23ee1-6821-49df-8abb-0e47396330c4', 'volume_size': 1} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:01 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 Sep 22 18:39:01 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (86d43c1b-35c0-486e-bfcc-4ecb1af70ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d69ed0-2bc1-439e-8700-55eab9a1520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d69ed0-2bc1-439e-8700-55eab9a1520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014100421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2ed82-0f51-4407-b8e4-5a2744f8caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2067643-52ae-4bb5-9872-525e2006f5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2067643-52ae-4bb5-9872-525e2006f5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab79340-3a96-416a-8eec-0b16b1aa3abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab79340-3a96-416a-8eec-0b16b1aa3abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c2ed82-0f51-4407-b8e4-5a2744f8caf4', 'volume_name': 'volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930b3a82-8e99-45ce-95f8-8376580f2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930b3a82-8e99-45ce-95f8-8376580f2662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d5d799-474d-4063-9241-c92304cc5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Volume 50c2ed82-0f51-4407-b8e4-5a2744f8caf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4', 'volume_size': 1} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:01 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2" returned: 0 in 0.432s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334095580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2847a9d-5b19-488d-99e3-fca24202be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Creating volume c2847a9d-5b19-488d-99e3-fca24202be5c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:01 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44bc96f-f307-4767-81c5-2e6f60e8611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb74935e-d807-4823-847e-af1e019500a2', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c 1073741824 Sep 22 18:39:01 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f3a912-6548-4d21-9c41-e3d5549396e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Volume volume-bb74935e-d807-4823-847e-af1e019500a2 (bb74935e-d807-4823-847e-af1e019500a2): created successfully Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f3a912-6548-4d21-9c41-e3d5549396e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (a29634f2-391b-4077-a97a-b9a644ab8581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-56cde534-2801-4a2e-bda4-90362be8a7ad tempest-CreateVolumesFromImageTest-1058983137 None] Created volume successfully. Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (db908b15-715f-4077-96c4-844c758cb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2035377e-3909-4efc-95ed-90bd56565bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2035377e-3909-4efc-95ed-90bd56565bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356592474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9958fa83-711c-4e41-a079-49fa7359ec50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:02Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5b9568-916c-4079-9f67-4224ca341564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5b9568-916c-4079-9f67-4224ca341564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18a671f-c4f6-4833-9e69-31e7013c5a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18a671f-c4f6-4833-9e69-31e7013c5a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9958fa83-711c-4e41-a079-49fa7359ec50', 'volume_name': 'volume-9958fa83-711c-4e41-a079-49fa7359ec50', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d900a7-9f77-4330-8ec5-af81b474f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d900a7-9f77-4330-8ec5-af81b474f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc40907a-a5de-4daa-a2cd-0d6435b3209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Volume 9958fa83-711c-4e41-a079-49fa7359ec50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9958fa83-711c-4e41-a079-49fa7359ec50', 'volume_size': 1} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:02 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (aa85d31d-56bd-4a5a-92f5-9daf92fa9a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb349d1-a670-4e94-a7af-a83a10f41d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c 1073741824" returned: 0 in 0.754s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb349d1-a670-4e94-a7af-a83a10f41d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460332568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce7732f-4b21-4026-bd14-c9cc850a2f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:02Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea4e65-4525-476c-b408-0f5ee4030854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea4e65-4525-476c-b408-0f5ee4030854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d56a2-eae2-4238-8eba-55fd193b61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d56a2-eae2-4238-8eba-55fd193b61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce7732f-4b21-4026-bd14-c9cc850a2f5f', 'volume_name': 'volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a5520e-07e6-4009-87bc-67ffc501c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a5520e-07e6-4009-87bc-67ffc501c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eeaecb-5dcb-43d0-aa59-368aaf43fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Volume 6ce7732f-4b21-4026-bd14-c9cc850a2f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f', 'volume_size': 1} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:02 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c Sep 22 18:39:02 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:02 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c" returned: 0 in 0.311s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-657943711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de23ee1-6821-49df-8abb-0e47396330c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume 7de23ee1-6821-49df-8abb-0e47396330c4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:02 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:02 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 1073741824 Sep 22 18:39:02 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5f0438-275e-4406-9c6f-104882d6fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2847a9d-5b19-488d-99e3-fca24202be5c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22903321-38c3-4594-9c3b-0b13faad8d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Volume volume-c2847a9d-5b19-488d-99e3-fca24202be5c (c2847a9d-5b19-488d-99e3-fca24202be5c): created successfully Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22903321-38c3-4594-9c3b-0b13faad8d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (ebfbdf2d-fc42-4a19-975a-7cf818c55148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6635fa52-7177-4cfd-a4d7-9c87ecafe829 tempest-CreateVolumesFromImageTest-1058983137 None] Created volume successfully. Sep 22 18:39:03 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 1073741824" returned: 0 in 0.586s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:03 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 Sep 22 18:39:03 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:03 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4" returned: 0 in 0.300s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014100421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2ed82-0f51-4407-b8e4-5a2744f8caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:01Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Creating volume 50c2ed82-0f51-4407-b8e4-5a2744f8caf4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:03 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89448fc4-a83b-4b9a-946b-da55cbe1061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de23ee1-6821-49df-8abb-0e47396330c4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22160033-7c00-4fb3-b7e6-1127596ad231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:03 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 1073741824 Sep 22 18:39:03 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:03 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-7de23ee1-6821-49df-8abb-0e47396330c4 (7de23ee1-6821-49df-8abb-0e47396330c4): created successfully Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22160033-7c00-4fb3-b7e6-1127596ad231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:03 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (e7864271-0fe1-4b71-9670-3c77dc5043d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1c56b2ce-cb95-4d12-b4b7-5b8c36743ab0 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Flow 'volume_create_manager' (d5a1268f-ea20-40de-8bb6-41ecaa1ca41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b007b5-16dc-4861-a705-89b9e03fbbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b007b5-16dc-4861-a705-89b9e03fbbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ac26975ea848d1a34b562cb0dda74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:04Z,use_quota=True,user_id='c02233d4519f4bf0ae6059f06cf454aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d661d2d5-a855-414d-8745-597c5dd173d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d661d2d5-a855-414d-8745-597c5dd173d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695107b3-111e-4432-aa03-280778b8d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:39:04 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 1073741824" returned: 0 in 0.732s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:04 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 Sep 22 18:39:04 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (f5c924f8-6339-4ef1-b00d-14c76dbed4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b77ff7-e5ff-4891-abc2-325d451bc28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b77ff7-e5ff-4891-abc2-325d451bc28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393593296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b241a5f4-bdf7-4e26-90f7-d9f298210781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e0ad7-fa85-4fcf-b18d-59d5d6697429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e0ad7-fa85-4fcf-b18d-59d5d6697429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c621f6d-9614-4be4-8a2f-7d5e00d62852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c621f6d-9614-4be4-8a2f-7d5e00d62852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b241a5f4-bdf7-4e26-90f7-d9f298210781', 'volume_name': 'volume-b241a5f4-bdf7-4e26-90f7-d9f298210781', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af7ce9-20d6-4281-a046-4695560df626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af7ce9-20d6-4281-a046-4695560df626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1b7d7-641d-44ab-b136-9d5a77c7138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume b241a5f4-bdf7-4e26-90f7-d9f298210781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b241a5f4-bdf7-4e26-90f7-d9f298210781', 'volume_size': 1} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695107b3-111e-4432-aa03-280778b8d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa', 'volume_name': 'volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa', 'volume_size': 1, 'image_id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fab462810822387a699ca24f3dd8131', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ac26975ea848d1a34b562cb0dda74f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fca1106acd4fb0af3867d02f36582116515e33d51a042882e0d164a732343ba46a24f64aeb01bc16ddbf1cf72425e8b8ff4ad1ca93dd09527b7b6bfeecf7bcb', 'id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da84dbe4-d59f-462c-9488-bcebe509750a/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2483a735-d65f-41fa-9f72-c96f8c22186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2483a735-d65f-41fa-9f72-c96f8c22186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef06603d-4e00-4fc0-8bc1-b7a79720b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:04 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa', 'volume_size': 1, 'image_id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fab462810822387a699ca24f3dd8131', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ac26975ea848d1a34b562cb0dda74f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fca1106acd4fb0af3867d02f36582116515e33d51a042882e0d164a732343ba46a24f64aeb01bc16ddbf1cf72425e8b8ff4ad1ca93dd09527b7b6bfeecf7bcb', 'id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da84dbe4-d59f-462c-9488-bcebe509750a/file', 'properties': {}}, 'image_service': } Sep 22 18:39:04 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Trying to clone 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa from image da84dbe4-d59f-462c-9488-bcebe509750a at location (None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" returned: 0 in 0.402s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.868s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356592474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9958fa83-711c-4e41-a079-49fa7359ec50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:02Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Creating volume 9958fa83-711c-4e41-a079-49fa7359ec50 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:04 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:04 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 1073741824 Sep 22 18:39:04 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d5d799-474d-4063-9241-c92304cc5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ce2328-c323-4ac4-b33e-b207d2f3c555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Volume volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 (50c2ed82-0f51-4407-b8e4-5a2744f8caf4): created successfully Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ce2328-c323-4ac4-b33e-b207d2f3c555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (86d43c1b-35c0-486e-bfcc-4ecb1af70ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d9678630-9b29-4d8b-b7f4-7d5d92e6eb38 tempest-CreateVolumesFromImageTest-1058983137 None] Created volume successfully. Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:39:05 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Image download 0.00 MB at 0.00 MB/s Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Flow 'volume_create_manager' (4b835b7a-48f2-4616-8263-c6cca062bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848641e7-983c-4090-a2fa-599c15407f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848641e7-983c-4090-a2fa-599c15407f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e692e72-7e60-4fdc-8d3d-df0bb7e318c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efea3efe01a94c7aa1397161229ef41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='33b8cb98733240cca31f220e1a6e9522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5bf386a-575f-48f3-8f01-61eb6565dc34),volume_type_id=f5bf386a-575f-48f3-8f01-61eb6565dc34)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcec077-8c5a-4b90-a67d-38233feb7f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcec077-8c5a-4b90-a67d-38233feb7f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9589a45-fa74-484f-80cd-360d059c635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.image.glance [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Creating Keystone auth plugin from conf {{(pid=86046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb38d33f-29e4-4dc1-8546-64fa31c23f0a]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:05 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:05 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (af5bd048-828c-42f6-b06a-4dcc8d75bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4599880-01d7-45a1-b9dd-bd8cc116feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 1073741824" returned: 0 in 0.714s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4599880-01d7-45a1-b9dd-bd8cc116feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403347791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbebdac4-f022-4809-8545-b6081a8d47d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82420744-7d79-4fda-b5d6-75fec293b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82420744-7d79-4fda-b5d6-75fec293b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27862343-20a3-4fea-8313-44dced7e3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27862343-20a3-4fea-8313-44dced7e3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbebdac4-f022-4809-8545-b6081a8d47d1', 'volume_name': 'volume-dbebdac4-f022-4809-8545-b6081a8d47d1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf23e4d-8d59-4eea-9784-dc0e84777342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf23e4d-8d59-4eea-9784-dc0e84777342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c015d6-db44-4d1c-b590-d7f2a35c4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume dbebdac4-f022-4809-8545-b6081a8d47d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbebdac4-f022-4809-8545-b6081a8d47d1', 'volume_size': 1} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9589a45-fa74-484f-80cd-360d059c635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e692e72-7e60-4fdc-8d3d-df0bb7e318c4', 'volume_name': 'volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4', 'volume_size': 1, 'image_id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6455e9857a579b9aef9f68d3bc0db7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efea3efe01a94c7aa1397161229ef41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9d4f9135d602d90e2df003d49d1e82b42a7de02ac479ed108dc833051817374cf3a0d97abff000be507050f5702bbd6c39b203824870e33ffa75c7637966a940', 'id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc41c31-06ab-4f05-a20e-c142f8921583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc41c31-06ab-4f05-a20e-c142f8921583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e311c227-2ded-448f-bd23-9ee1f2623b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4', 'volume_size': 1, 'image_id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6455e9857a579b9aef9f68d3bc0db7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efea3efe01a94c7aa1397161229ef41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9d4f9135d602d90e2df003d49d1e82b42a7de02ac479ed108dc833051817374cf3a0d97abff000be507050f5702bbd6c39b203824870e33ffa75c7637966a940', 'id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Trying to clone 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 from image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}]). {{(pid=86046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 22 18:39:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:05 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 Sep 22 18:39:05 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:05 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:05 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Image download 0.00 MB at 0.00 MB/s Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (f2fa4021-4aa8-452e-9271-c858ce387633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f67e4-1cc6-45a3-86c3-666ab6f11673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f67e4-1cc6-45a3-86c3-666ab6f11673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492304009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f2308-20b9-48e6-b19a-8d1ce507790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:06Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f15234-459e-477e-9da1-8e33e2d7db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f15234-459e-477e-9da1-8e33e2d7db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d80f32-588b-4451-83b5-71fbc0f67da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d80f32-588b-4451-83b5-71fbc0f67da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5f2308-20b9-48e6-b19a-8d1ce507790e', 'volume_name': 'volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147dfe83-ff2f-412b-bacd-451852594ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147dfe83-ff2f-412b-bacd-451852594ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8350a37c-e850-4659-bb9e-16047975f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume 9b5f2308-20b9-48e6-b19a-8d1ce507790e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e', 'volume_size': 1} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a083c76-7881-438d-a38c-5a8849f7f500]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50" returned: 0 in 0.422s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:06 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.890s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460332568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce7732f-4b21-4026-bd14-c9cc850a2f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717e82d9bc2c4344b474900c99bfe11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:02Z,use_quota=True,user_id='3c0c8d122f8f4d0b9fc44d8cc50a891d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Creating volume 6ce7732f-4b21-4026-bd14-c9cc850a2f5f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 1 in 0.563s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Temporary image da84dbe4-d59f-462c-9488-bcebe509750a is fetched for user c02233d4519f4bf0ae6059f06cf454aa. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc40907a-a5de-4daa-a2cd-0d6435b3209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9958fa83-711c-4e41-a079-49fa7359ec50', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dd4479-a8db-4563-abaa-2db09fee4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f 1073741824 Sep 22 18:39:06 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Volume volume-9958fa83-711c-4e41-a079-49fa7359ec50 (9958fa83-711c-4e41-a079-49fa7359ec50): created successfully Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dd4479-a8db-4563-abaa-2db09fee4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (db908b15-715f-4077-96c4-844c758cb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c86f6da7-6df3-469f-b616-c29ab9eaa1ca tempest-CreateVolumesFromImageTest-1058983137 None] Created volume successfully. Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79e4eda-fc85-4156-9de3-b00b402db16a]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:06 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:06 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:06 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:06 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:06 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (2f727aa5-020a-4b6e-996f-507f851ae749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5403af7e-6cde-41c3-8f8c-3d60793c55f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5403af7e-6cde-41c3-8f8c-3d60793c55f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681527209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:07Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61276440-ec86-4c2b-8d73-1abdc073c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61276440-ec86-4c2b-8d73-1abdc073c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6fe9f-1b56-4c8a-8a58-e2fed92b210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6fe9f-1b56-4c8a-8a58-e2fed92b210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7', 'volume_name': 'volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a9aec-4070-4119-8380-cf9009a00437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a9aec-4070-4119-8380-cf9009a00437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96415b7c-23d9-4abf-be72-db306d09c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:06 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7', 'volume_size': 1} Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:06 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f 1073741824" returned: 0 in 0.678s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:06 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:06 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f Sep 22 18:39:07 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 0 in 0.635s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:07 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:07 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (0be6ff5c-a4c2-42a7-a572-c0c697ca7e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a69f6c-8b54-4b78-b077-746357f8f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 1 in 0.576s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Temporary image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe is fetched for user 33b8cb98733240cca31f220e1a6e9522. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a69f6c-8b54-4b78-b077-746357f8f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945556773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfed3ad-e459-48e9-8da5-cea67e90ad42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:07Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71490500-9f15-4e78-b49a-572d1f27770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71490500-9f15-4e78-b49a-572d1f27770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c31e7fd-784d-4b52-8234-53bf72950b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c31e7fd-784d-4b52-8234-53bf72950b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfed3ad-e459-48e9-8da5-cea67e90ad42', 'volume_name': 'volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7aa167-e3fd-468a-a69f-c8c5d0ef7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7aa167-e3fd-468a-a69f-c8c5d0ef7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60cde56-4ee0-481e-a42b-fbcf4d963c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume 4cfed3ad-e459-48e9-8da5-cea67e90ad42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42', 'volume_size': 1} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" returned: 0 in 0.361s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.538s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393593296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b241a5f4-bdf7-4e26-90f7-d9f298210781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume b241a5f4-bdf7-4e26-90f7-d9f298210781 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:07 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 1073741824 Sep 22 18:39:07 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eeaecb-5dcb-43d0-aa59-368aaf43fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971f75ce-8010-41fa-b924-122a29e68127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4657ba-758e-4120-95eb-d15563581622]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Volume volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f (6ce7732f-4b21-4026-bd14-c9cc850a2f5f): created successfully Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971f75ce-8010-41fa-b924-122a29e68127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Flow 'volume_create_manager' (aa85d31d-56bd-4a5a-92f5-9daf92fa9a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:07 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b1ec7ba2-a30d-4d67-b308-2367acb61859 tempest-CreateVolumesFromImageTest-1058983137 None] Created volume successfully. Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:07 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:07 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 1073741824" returned: 0 in 0.494s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:07 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:07 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:07 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 Sep 22 18:39:07 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-6ce7732f-4b21-4026-bd14-c9cc850a2f5f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-6ce7732f-4b21-4026-bd14-c9cc850a2f5f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-quobyte-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" acquired by "delete_volume" :: waited 0.032s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aeac1b-01f9-4ea4-9fbf-254b04e1b760]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:08 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403347791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbebdac4-f022-4809-8545-b6081a8d47d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume dbebdac4-f022-4809-8545-b6081a8d47d1 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:08 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:08 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da1b7d7-641d-44ab-b136-9d5a77c7138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b241a5f4-bdf7-4e26-90f7-d9f298210781', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:08 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 1073741824 Sep 22 18:39:08 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cbcfec-c941-4775-a559-3316aed1c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 1 in 0.539s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:08 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 (b241a5f4-bdf7-4e26-90f7-d9f298210781): created successfully Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cbcfec-c941-4775-a559-3316aed1c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (f5c924f8-6339-4ef1-b00d-14c76dbed4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-acccba16-723b-4968-ab62-8ee7e35fdd0b tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:08 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f Sep 22 18:39:08 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:08 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" returned: 0 in 0.470s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:08 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f Sep 22 18:39:08 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:08 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 1073741824" returned: 0 in 0.512s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:08 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 Sep 22 18:39:08 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:08 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-6ce7732f-4b21-4026-bd14-c9cc850a2f5f" released by "delete_volume" :: held 0.786s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Created reservations ['02501c29-2234-4e03-b636-6796f069e20f', 'c6174b8d-22c4-46cf-8dc6-c9b70a81e5db', 'c8ace63c-fd8e-4991-9b60-f6a27c1013d0', '56650779-40ea-4459-96b2-71ecd249234e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:09 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492304009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f2308-20b9-48e6-b19a-8d1ce507790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:06Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume 9b5f2308-20b9-48e6-b19a-8d1ce507790e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e 1073741824 Sep 22 18:39:09 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c015d6-db44-4d1c-b590-d7f2a35c4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbebdac4-f022-4809-8545-b6081a8d47d1', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2d943-cf1f-4ef9-9508-fd3cb9f29dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-dbebdac4-f022-4809-8545-b6081a8d47d1 (dbebdac4-f022-4809-8545-b6081a8d47d1): created successfully Sep 22 18:39:09 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2d943-cf1f-4ef9-9508-fd3cb9f29dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:09 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (af5bd048-828c-42f6-b06a-4dcc8d75bff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a3652949-de25-49d3-abf2-5876785eb875 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-9958fa83-711c-4e41-a079-49fa7359ec50-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-9958fa83-711c-4e41-a079-49fa7359ec50-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-quobyte-9958fa83-711c-4e41-a079-49fa7359ec50" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-9958fa83-711c-4e41-a079-49fa7359ec50" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3ed656-ce9c-45c3-838c-309ae5089eae]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.389s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Deleted volume successfully. Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-cb2998e7-c861-4d55-bea2-122db2cf32e3 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-6ce7732f-4b21-4026-bd14-c9cc850a2f5f-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:09 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 Sep 22 18:39:09 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e 1073741824" returned: 0 in 0.507s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e Sep 22 18:39:09 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50 Sep 22 18:39:09 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681527209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:07Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8350a37c-e850-4659-bb9e-16047975f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:09 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 1073741824 Sep 22 18:39:09 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e699b-3931-474b-a2ec-9f801ec2b924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e (9b5f2308-20b9-48e6-b19a-8d1ce507790e): created successfully Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e699b-3931-474b-a2ec-9f801ec2b924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (f2fa4021-4aa8-452e-9271-c858ce387633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8c89d9dd-d85e-4c5c-acb1-8986ecf15262 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:10 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9958fa83-711c-4e41-a079-49fa7359ec50" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-9958fa83-711c-4e41-a079-49fa7359ec50" released by "delete_volume" :: held 0.680s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Created reservations ['f8fcfde9-fb1d-4c5b-86c7-aaeac80c6032', '2f9aa3b0-d4a7-4dcd-b697-dc0710ef72c5', 'c215296b-8439-45f6-91f7-d5e0f45a0cae', '5b1e0209-30ed-4b6f-aacf-7262473158ce'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:10 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:10 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:10 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 1073741824" returned: 0 in 0.467s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-50c2ed82-0f51-4407-b8e4-5a2744f8caf4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:10 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 Sep 22 18:39:10 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-50c2ed82-0f51-4407-b8e4-5a2744f8caf4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:10 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.294s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Deleted volume successfully. Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-quobyte-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e9622e28-feb5-4036-9a01-1a33b7485bdb tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-9958fa83-711c-4e41-a079-49fa7359ec50-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2823858-f427-4348-a662-f81dbd3df253]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:10 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 Sep 22 18:39:10 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:10 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.411s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945556773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfed3ad-e459-48e9-8da5-cea67e90ad42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb46a61cfb49f8871f2018e247c9f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:07Z,use_quota=True,user_id='9869303dde3b44bcb86cc2b41cb899b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Creating volume 4cfed3ad-e459-48e9-8da5-cea67e90ad42 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:10 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96415b7c-23d9-4abf-be72-db306d09c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:10 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 1073741824 Sep 22 18:39:10 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e01ebef-7796-491c-9713-c4f9dbccc968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 (b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7): created successfully Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e01ebef-7796-491c-9713-c4f9dbccc968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (2f727aa5-020a-4b6e-996f-507f851ae749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:10 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-27bfab68-524e-4fda-99e8-e3a49cf95788 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:11 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" returned: 0 in 0.396s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:11 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4 Sep 22 18:39:11 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:11 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 1073741824" returned: 0 in 0.461s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:11 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-50c2ed82-0f51-4407-b8e4-5a2744f8caf4" released by "delete_volume" :: held 0.710s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:11 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 Sep 22 18:39:11 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Created reservations ['c44dd39f-8668-465f-8b4b-a97543c80679', '662b76b8-0f99-4512-9071-e2f3cacc233c', '1a62812d-3483-40ef-90ff-b88c1090a1e9', 'c70f0aad-b8ec-429b-b342-b55a934df88f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:11 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:11 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:11 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.062s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ac26975ea848d1a34b562cb0dda74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:04Z,use_quota=True,user_id='c02233d4519f4bf0ae6059f06cf454aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Creating volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:11 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60cde56-4ee0-481e-a42b-fbcf4d963c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b547b-6467-4de0-b718-322feae93efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:11 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1073741824 Sep 22 18:39:11 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Volume volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 (4cfed3ad-e459-48e9-8da5-cea67e90ad42): created successfully Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b547b-6467-4de0-b718-322feae93efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Flow 'volume_create_manager' (0be6ff5c-a4c2-42a7-a572-c0c697ca7e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-c2847a9d-5b19-488d-99e3-fca24202be5c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5696e7a2-b3f7-420b-817a-10ab0ccc729a tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created volume successfully. Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-c2847a9d-5b19-488d-99e3-fca24202be5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:11 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Deleted volume successfully. Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-quobyte-c2847a9d-5b19-488d-99e3-fca24202be5c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-c2847a9d-5b19-488d-99e3-fca24202be5c" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bd6c66f5-04b0-44cd-9ec0-e75c07cbbf0b tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-50c2ed82-0f51-4407-b8e4-5a2744f8caf4-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8140cb-7883-4ce7-94ff-a1f5ea7822d3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-4cfed3ad-e459-48e9-8da5-cea67e90ad42-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-4cfed3ad-e459-48e9-8da5-cea67e90ad42-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:11 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c Sep 22 18:39:11 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-4cfed3ad-e459-48e9-8da5-cea67e90ad42" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-4cfed3ad-e459-48e9-8da5-cea67e90ad42" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c2c7f-1f64-4008-8dec-b02ce33077c5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 Sep 22 18:39:12 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1073741824" returned: 0 in 0.593s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa Sep 22 18:39:12 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c" returned: 0 in 0.444s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c Sep 22 18:39:12 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42 Sep 22 18:39:12 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.114s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e692e72-7e60-4fdc-8d3d-df0bb7e318c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efea3efe01a94c7aa1397161229ef41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:05Z,use_quota=True,user_id='33b8cb98733240cca31f220e1a6e9522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5bf386a-575f-48f3-8f01-61eb6565dc34),volume_type_id=f5bf386a-575f-48f3-8f01-61eb6565dc34)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Creating volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:12 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1073741824 Sep 22 18:39:12 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Attempting download of da84dbe4-d59f-462c-9488-bcebe509750a ((None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}])) to volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c2847a9d-5b19-488d-99e3-fca24202be5c" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-c2847a9d-5b19-488d-99e3-fca24202be5c" released by "delete_volume" :: held 0.778s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f883cfb-0c31-426d-b366-e74b332fd3f2]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Created reservations ['5a9b323e-a7ba-477b-9ad1-6342515c5c96', '5494df35-fe0c-4a77-953d-5261ae1d2e67', 'fb6412b9-b2f6-47b5-81b7-4cd824f7f063', '9bf051c6-0308-4989-bc2c-d21b83b8aa0c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:12 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:12 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk Sep 22 18:39:12 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4cfed3ad-e459-48e9-8da5-cea67e90ad42" returned: 0 in 0.336s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:12 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:12 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-4cfed3ad-e459-48e9-8da5-cea67e90ad42" released by "delete_volume" :: held 0.794s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['d441fa55-b29f-4f81-a303-e6a98dc46665', '0ccc1409-2273-40fa-84f4-057eda4a4ade', 'e7bb0a09-42c6-475c-b95a-e80e35ca0fd5', '5e68b08b-51a4-4000-b832-8f786941a0b4'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-bb74935e-d807-4823-847e-af1e019500a2-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-bb74935e-d807-4823-847e-af1e019500a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "cinder-quobyte-bb74935e-d807-4823-847e-af1e019500a2" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-bb74935e-d807-4823-847e-af1e019500a2" acquired by "delete_volume" :: waited 0.055s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:13 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:13 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecf261-5bc4-478f-8f5b-ca9eb6d11472]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk" returned: 0 in 0.520s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.379s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Deleted volume successfully. Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3f551dda-c62f-4052-b126-769e70c6dbf8 tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-c2847a9d-5b19-488d-99e3-fca24202be5c-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:13 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1073741824" returned: 0 in 0.714s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 Sep 22 18:39:13 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk Sep 22 18:39:13 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 Sep 22 18:39:13 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" acquired by "delete_volume" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[836994f6-e7f9-45ae-ae80-64adee2e7262]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.375s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-bf833006-8ffa-453b-b3e0-a5def04b9d21 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-4cfed3ad-e459-48e9-8da5-cea67e90ad42-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:13 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 Sep 22 18:39:13 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk" returned: 1 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da84dbe4-d59f-462c-9488-bcebe509750a_wh7lq5gk' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2a78b-48b6-4421-ac48-0412b6f73ae7]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" returned: 0 in 0.322s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Attempting download of 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe ((None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}])) to volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 22 18:39:13 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2" returned: 0 in 0.574s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd29594-98bb-402f-90dc-47421faf1487]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2 Sep 22 18:39:13 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:13 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6 Sep 22 18:39:13 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" returned: 0 in 0.517s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bb74935e-d807-4823-847e-af1e019500a2" returned: 0 in 0.269s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7 Sep 22 18:39:13 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-quobyte-bb74935e-d807-4823-847e-af1e019500a2" released by "delete_volume" :: held 0.929s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:14 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6" returned: 0 in 0.402s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Created reservations ['40361958-fbf9-49f6-9b98-cd132d90b444', '9cd0d991-0b2e-493e-8603-3ddb53982f63', '74184f5e-7790-41c9-bb96-0f60a02e7d4a', 'f33e32f1-83d9-4a0d-b998-1b6352502ea1'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:14 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD Sep 22 18:39:14 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" returned: 0 in 0.325s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:14 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6 Sep 22 18:39:14 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7" released by "delete_volume" :: held 0.914s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:14 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:14 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['e631e3fa-73c2-474d-a214-561339b46a30', 'c075b2ca-0eb0-4861-8e1a-3fe482bfc613', '618bfda4-6fe3-499d-a4d7-d6d698d94100', '3037da7a-5676-42e8-a9e4-aa7d9c4c8a8f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD" returned: 1 in 0.491s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] da84dbe4-d59f-462c-9488-bcebe509750a was raw, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:14 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa Sep 22 18:39:14 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-9b5f2308-20b9-48e6-b19a-8d1ce507790e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6" returned: 1 in 0.443s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_ha9wq0i6' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d019554-0e30-46d8-9cf1-b73756293094]: (4, 'raw') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-9b5f2308-20b9-48e6-b19a-8d1ce507790e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:14 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-9b5f2308-20b9-48e6-b19a-8d1ce507790e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.399s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-9b5f2308-20b9-48e6-b19a-8d1ce507790e" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Deleted volume successfully. Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69149a79-d827-4a2d-9fd9-ae9c5241a39a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:14 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:14 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:14 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-423b6c39-c9ee-4afb-979a-5ceef0b0e07c tempest-CreateVolumesFromImageTest-1058983137 None] Lock "cinder-bb74935e-d807-4823-847e-af1e019500a2-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:14 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fbda75c1-d2f0-40f0-a624-01a2c9b20838 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-b3b128a3-4715-4c0e-b7c1-fdfd73cc14a7-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:14 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e Sep 22 18:39:14 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:15 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" returned: 0 in 0.583s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da84dbe4-d59f-462c-9488-bcebe509750a_u_ce4je9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:39:15 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:15 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1G Sep 22 18:39:15 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD Sep 22 18:39:15 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e" returned: 0 in 0.422s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:15 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e Sep 22 18:39:15 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe was raw, converting to qcow2 {{(pid=86046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:15 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa 1G" returned: 0 in 0.372s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Downloaded image da84dbe4-d59f-462c-9488-bcebe509750a ((None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}])) to volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Temporary image da84dbe4-d59f-462c-9488-bcebe509750a for user c02233d4519f4bf0ae6059f06cf454aa is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Marking volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Copying metadata from image da84dbe4-d59f-462c-9488-bcebe509750a to 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:39:15 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Creating volume glance metadata for volume 6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa backed by image da84dbe4-d59f-462c-9488-bcebe509750a with: {'image_id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1fab462810822387a699ca24f3dd8131', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9b5f2308-20b9-48e6-b19a-8d1ce507790e" returned: 0 in 0.298s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-9b5f2308-20b9-48e6-b19a-8d1ce507790e" released by "delete_volume" :: held 0.794s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef06603d-4e00-4fc0-8bc1-b7a79720b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa', 'volume_size': 1, 'image_id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da84dbe4-d59f-462c-9488-bcebe509750a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fab462810822387a699ca24f3dd8131', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ac26975ea848d1a34b562cb0dda74f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fca1106acd4fb0af3867d02f36582116515e33d51a042882e0d164a732343ba46a24f64aeb01bc16ddbf1cf72425e8b8ff4ad1ca93dd09527b7b6bfeecf7bcb', 'id': 'da84dbe4-d59f-462c-9488-bcebe509750a', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da84dbe4-d59f-462c-9488-bcebe509750a/file', 'properties': {}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e551696-e57f-4000-a74b-a4c049fe7540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['91d3873a-a4df-4358-84dc-814f3d482cb0', 'e0b03190-99e7-4365-8a26-ac120dfea573', '032f8674-7c37-48ca-837a-4ffafb319fec', '094850c4-d6ca-4a05-b637-eb53f4328f65'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:15 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Volume volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa (6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa): created successfully Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e551696-e57f-4000-a74b-a4c049fe7540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Flow 'volume_create_manager' (d5a1268f-ea20-40de-8bb6-41ecaa1ca41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1f4b8a67-8cab-4197-96c6-9991e73cff5b tempest-VolumeImageDependencyTests-211584766 None] Created volume successfully. Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:15 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:15 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-dbebdac4-f022-4809-8545-b6081a8d47d1-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-dbebdac4-f022-4809-8545-b6081a8d47d1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-dbebdac4-f022-4809-8545-b6081a8d47d1" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-dbebdac4-f022-4809-8545-b6081a8d47d1" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[517c53b6-6981-47b5-8743-f02027a52082]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" returned: 0 in 0.628s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27cf627a-c4cb-4d5d-9993-d3c8aa0456fe_rc4f0i5ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:39:16 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 Sep 22 18:39:16 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:16 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1G Sep 22 18:39:16 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.394s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d5eea20d-fc43-4ad8-8f5e-7b20f85aaec3 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-9b5f2308-20b9-48e6-b19a-8d1ce507790e-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Acquiring lock "cinder-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "cinder-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:16 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Acquiring lock "cinder-quobyte-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1" returned: 0 in 0.496s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "cinder-quobyte-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:16 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1 Sep 22 18:39:16 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aba72c-5c61-4197-8e43-37033bea1547]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 1G" returned: 0 in 0.518s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Downloaded image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe ((None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}])) to volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 successfully. {{(pid=86046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Temporary image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe for user 33b8cb98733240cca31f220e1a6e9522 is deleted. {{(pid=86046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.volume_utils [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Marking volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 as bootable. {{(pid=86046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Copying metadata from image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe to 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4. {{(pid=86046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Creating volume glance metadata for volume 8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 backed by image 27cf627a-c4cb-4d5d-9993-d3c8aa0456fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b6455e9857a579b9aef9f68d3bc0db7e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 18:39:16 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa Sep 22 18:39:16 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e311c227-2ded-448f-bd23-9ee1f2623b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4', 'volume_size': 1, 'image_id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6455e9857a579b9aef9f68d3bc0db7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efea3efe01a94c7aa1397161229ef41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9d4f9135d602d90e2df003d49d1e82b42a7de02ac479ed108dc833051817374cf3a0d97abff000be507050f5702bbd6c39b203824870e33ffa75c7637966a940', 'id': '27cf627a-c4cb-4d5d-9993-d3c8aa0456fe', 'created_at': datetime.datetime(2026, 9, 22, 16, 39, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 16, 39, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27cf627a-c4cb-4d5d-9993-d3c8aa0456fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f875c85-751b-40f5-8498-d1dc5c16e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Volume volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 (8e692e72-7e60-4fdc-8d3d-df0bb7e318c4): created successfully Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f875c85-751b-40f5-8498-d1dc5c16e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Flow 'volume_create_manager' (4b835b7a-48f2-4616-8263-c6cca062bc60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aaa7bece-e4b3-4eea-8674-e3611bfa5bf3 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Created volume successfully. Sep 22 18:39:16 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dbebdac4-f022-4809-8545-b6081a8d47d1" returned: 0 in 0.373s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-dbebdac4-f022-4809-8545-b6081a8d47d1" released by "delete_volume" :: held 0.922s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['5ba27ef5-5b73-4f88-b7e4-c641aa333a5b', '0659c739-d88e-4210-9f69-36ff2c154ed6', '95235262-28a8-4491-a083-5cce02637120', 'cc527281-c637-4a8e-9867-a88f5d58be5a'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:16 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" returned: 0 in 0.498s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:16 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:16 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:16 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-b241a5f4-bdf7-4e26-90f7-d9f298210781-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:16 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa Sep 22 18:39:16 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-b241a5f4-bdf7-4e26-90f7-d9f298210781-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-b241a5f4-bdf7-4e26-90f7-d9f298210781" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-b241a5f4-bdf7-4e26-90f7-d9f298210781" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Acquiring lock "cinder-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "cinder-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7554d1-caa4-47f2-b15b-178b7caca5f5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Acquiring lock "cinder-quobyte-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "cinder-quobyte-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efdb076-9371-4b35-bab0-5102f2766b59]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:17 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.447s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:17 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:17 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f466108e-5c55-4799-8ea5-da94f27bcbf4 tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-dbebdac4-f022-4809-8545-b6081a8d47d1-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:17 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" returned: 0 in 0.542s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:17 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 Sep 22 18:39:17 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "cinder-quobyte-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa" released by "delete_volume" :: held 1.101s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Created reservations ['eff0f240-9c64-4059-a435-8aa8fbefab4d', '5607a6fa-b71e-4bcc-ab7c-fa0f8173f74a', 'd9b3f9d7-fc32-4ca2-9c9b-75b1dd11c50f', 'df9f229e-2c2a-4714-928d-bd98c0d4bb19'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:17 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:17 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:17 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781" returned: 0 in 0.543s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:17 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781 Sep 22 18:39:17 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:17 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" returned: 0 in 0.485s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:17 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4 Sep 22 18:39:17 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:18 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Deleted volume successfully. Sep 22 18:39:18 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b241a5f4-bdf7-4e26-90f7-d9f298210781" returned: 0 in 0.340s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9a15fd8a-1d3d-4878-b0b5-71a03939613d tempest-VolumeImageDependencyTests-211584766 None] Lock "cinder-6f9b8f0f-2f59-4231-8fe6-da39bbfe42aa-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-b241a5f4-bdf7-4e26-90f7-d9f298210781" released by "delete_volume" :: held 0.971s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:18 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" returned: 0 in 0.325s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "cinder-quobyte-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4" released by "delete_volume" :: held 0.871s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['d43962b3-f472-46dc-be41-d73ffe3323c1', '720367a5-d5c4-4b99-ae1d-7f1b0ce1b4aa', '427188f4-6be3-41e3-b874-e0e8598bf7ac', 'a49974eb-6c6c-4d8d-810e-1dd781ff1617'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Created reservations ['adc5f1f6-00fd-4cd8-b994-a8f8160af55b', '68bd2009-505d-42c6-813d-6d9918d343e3', '79109230-3ad2-497b-8730-bb7017ff1655', 'e7080eee-2c68-45fc-9afe-fa3db32da8b0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:18 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:18 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:18 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:18 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:18 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e36d305-e06e-4eda-b2ff-d78c84b2077c tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-b241a5f4-bdf7-4e26-90f7-d9f298210781-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:18 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Deleted volume successfully. Sep 22 18:39:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0646516c-5a91-4384-b65b-ad4d246e5009 tempest-VolumeAndVolumeTypeFromImageTest-1520471778 None] Lock "cinder-8e692e72-7e60-4fdc-8d3d-df0bb7e318c4-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-7de23ee1-6821-49df-8abb-0e47396330c4-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-7de23ee1-6821-49df-8abb-0e47396330c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "cinder-quobyte-7de23ee1-6821-49df-8abb-0e47396330c4" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-7de23ee1-6821-49df-8abb-0e47396330c4" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f218537-f942-4827-a73d-bcc1d0ca83b2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:19 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 Sep 22 18:39:19 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (c777342e-e5ad-4e8e-a776-2e947af540f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed5a7b9-b8fb-4669-84ea-ca791ec2d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed5a7b9-b8fb-4669-84ea-ca791ec2d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435157146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdc4978-1e81-4dcb-b015-09b21bf9380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:20Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247bc00f-3dea-443a-b1c1-5ba21d67c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247bc00f-3dea-443a-b1c1-5ba21d67c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa79348-1071-431b-9a3d-18c7965bb9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa79348-1071-431b-9a3d-18c7965bb9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdc4978-1e81-4dcb-b015-09b21bf9380f', 'volume_name': 'volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5733870-4378-4b79-a83a-bd0fed36a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5733870-4378-4b79-a83a-bd0fed36a22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2bc068-f895-407a-af6e-df7bcec10b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:19 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume 0fdc4978-1e81-4dcb-b015-09b21bf9380f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f', 'volume_size': 1} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435157146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdc4978-1e81-4dcb-b015-09b21bf9380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:20Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume 0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:19 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:19 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f 1073741824 Sep 22 18:39:19 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:20 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4" returned: 0 in 0.585s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:20 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4 Sep 22 18:39:20 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:20 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f 1073741824" returned: 0 in 0.604s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:20 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7de23ee1-6821-49df-8abb-0e47396330c4" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-quobyte-7de23ee1-6821-49df-8abb-0e47396330c4" released by "delete_volume" :: held 1.030s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:20 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f Sep 22 18:39:20 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Created reservations ['f3515b41-f8fd-474d-8992-8452b043e398', 'bf9c0567-c6ff-4463-a3e4-0fc1ed403ce4', '51fd7587-55be-4a63-8152-8c2c4112d0f3', 'd88e2e1a-a559-4c44-a999-d18a2a7aa41e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:20 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:20 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:20 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f" returned: 0 in 0.318s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2bc068-f895-407a-af6e-df7bcec10b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aea54e-733b-4071-8e79-29dabc90ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f (0fdc4978-1e81-4dcb-b015-09b21bf9380f): created successfully Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aea54e-733b-4071-8e79-29dabc90ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (c777342e-e5ad-4e8e-a776-2e947af540f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9e8b2931-2cf1-498b-aa97-43991568706e tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:20 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.334s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:20 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:21 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Deleted volume successfully. Sep 22 18:39:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0837126e-e4ef-4a51-9a48-bc4fa3ba0c5f tempest-CreateVolumesFromSourceVolumeTest-1008575189 None] Lock "cinder-7de23ee1-6821-49df-8abb-0e47396330c4-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating offline snapshot 02d79439-f61e-41d5-b063-6e9ab3373a82 of volume 0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3a624-4c55-459e-a3e4-77e16a9f1b97]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:22 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f Sep 22 18:39:22 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:22 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f" returned: 0 in 0.441s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 1G Sep 22 18:39:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:23 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 1G" returned: 0 in 0.623s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:23 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 Sep 22 18:39:23 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Flow 'volume_create_manager' (6c3713ac-04c7-4870-a78d-9560a949cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30be659a-242f-466d-b0e3-b794d4663a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30be659a-242f-466d-b0e3-b794d4663a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7a77ac-53d6-4d2f-9b55-f542cffa035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040f2dc929b4443b4ac4ed080124cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:23Z,use_quota=True,user_id='38b6f44991e34ae58d9ab27f1357085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e253ce5-9680-422f-9d94-4983f742b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e253ce5-9680-422f-9d94-4983f742b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff75fa6d-7bb7-4f2d-8285-2fe343dde16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff75fa6d-7bb7-4f2d-8285-2fe343dde16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7a77ac-53d6-4d2f-9b55-f542cffa035f', 'volume_name': 'volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d42e3-8095-4d6f-b230-9d41e078fd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d42e3-8095-4d6f-b230-9d41e078fd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065d48f5-c4ce-47f6-a87c-c8f0faf6f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:23 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Volume ee7a77ac-53d6-4d2f-9b55-f542cffa035f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f', 'volume_size': 1} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:23 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82" returned: 0 in 0.442s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:23 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 is being set with open permissions: ugo+rw Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:23 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 Sep 22 18:39:23 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:23 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82" returned: 0 in 0.281s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:23 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info Sep 22 18:39:23 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:24 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info" returned: 0 in 0.333s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:24 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info is being set with open permissions: ugo+rw Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:24 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info Sep 22 18:39:24 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:24 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.info" returned: 0 in 0.298s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7a77ac-53d6-4d2f-9b55-f542cffa035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040f2dc929b4443b4ac4ed080124cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:23Z,use_quota=True,user_id='38b6f44991e34ae58d9ab27f1357085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Creating volume ee7a77ac-53d6-4d2f-9b55-f542cffa035f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:24 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f 1073741824 Sep 22 18:39:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:24 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cc367696-cfce-4164-b49d-6fd9aa06fde2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Create snapshot completed successfully Sep 22 18:39:25 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f 1073741824" returned: 0 in 0.502s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:25 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f Sep 22 18:39:25 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:25 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" returned: 0 in 0.311s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065d48f5-c4ce-47f6-a87c-c8f0faf6f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c40d09a-7af7-4ca9-bd69-f06eaefe7035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Volume volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f (ee7a77ac-53d6-4d2f-9b55-f542cffa035f): created successfully Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c40d09a-7af7-4ca9-bd69-f06eaefe7035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Flow 'volume_create_manager' (6c3713ac-04c7-4870-a78d-9560a949cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fda7141a-5062-4fbf-b9ba-e14f19ebb0a0 tempest-CinderUnicodeTest-1522468798 None] Created volume successfully. Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Flow 'volume_create_manager' (8f9b0194-7010-4ffb-94fb-c17544577bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00aa7b20-b816-4753-a9c3-6eed5332bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00aa7b20-b816-4753-a9c3-6eed5332bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-48093628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b32acf-71fc-427d-8e61-6160cedee734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8637c16221471984f2a06206723f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:25Z,use_quota=True,user_id='d8a0c3111aa64db6ad5a0e0ac6c1cace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f131a7f2-dee3-4ef7-9a7c-1527be5202cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f131a7f2-dee3-4ef7-9a7c-1527be5202cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a89330-3e71-4a3f-85cb-a2a63f2eac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a89330-3e71-4a3f-85cb-a2a63f2eac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b32acf-71fc-427d-8e61-6160cedee734', 'volume_name': 'volume-d4b32acf-71fc-427d-8e61-6160cedee734', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032ea8ca-8606-4e80-b4b8-679623eeed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032ea8ca-8606-4e80-b4b8-679623eeed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce44993-b40f-4646-98ca-bcf4031ea59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Volume d4b32acf-71fc-427d-8e61-6160cedee734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b32acf-71fc-427d-8e61-6160cedee734', 'volume_size': 1} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-48093628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b32acf-71fc-427d-8e61-6160cedee734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8637c16221471984f2a06206723f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:25Z,use_quota=True,user_id='d8a0c3111aa64db6ad5a0e0ac6c1cace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Creating volume d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:25 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:25 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 1073741824 Sep 22 18:39:25 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (bef20f59-dc6c-4e6d-ae78-5e63d194d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37ae407-255e-4a2b-86fb-7420c7eccec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37ae407-255e-4a2b-86fb-7420c7eccec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51892595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c9adc9-06b9-4dda-b2f0-6e29d062ad99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:26Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2139c8-9fb6-45e9-89d0-c1984e0e600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2139c8-9fb6-45e9-89d0-c1984e0e600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f7db7e-a4b9-4f66-bc63-ae00e387355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f7db7e-a4b9-4f66-bc63-ae00e387355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c9adc9-06b9-4dda-b2f0-6e29d062ad99', 'volume_name': 'volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d3d2e9-c67d-4bf3-9d87-837f0c7732d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d3d2e9-c67d-4bf3-9d87-837f0c7732d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140b721-eddb-4991-80a8-2f296aaa7984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume d4c9adc9-06b9-4dda-b2f0-6e29d062ad99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99', 'volume_size': 1} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:26 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 1073741824" returned: 0 in 0.555s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:26 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:26 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (43e70343-20ba-4431-98ee-3a691510ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878ca71-3da9-4668-a1db-a3742fac18b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0878ca71-3da9-4668-a1db-a3742fac18b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647343034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea3c906-525f-48da-be4d-a3b2e10adffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:26Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6047c1-79db-4b53-87c8-406ebfcbb063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6047c1-79db-4b53-87c8-406ebfcbb063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacad37b-5a55-4ed6-9205-30873abced54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacad37b-5a55-4ed6-9205-30873abced54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea3c906-525f-48da-be4d-a3b2e10adffe', 'volume_name': 'volume-bea3c906-525f-48da-be4d-a3b2e10adffe', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a19dabd-f389-452d-ae8f-a5e87f36ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a19dabd-f389-452d-ae8f-a5e87f36ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace5938-7c54-4312-ae31-2de954fe804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume bea3c906-525f-48da-be4d-a3b2e10adffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea3c906-525f-48da-be4d-a3b2e10adffe', 'volume_size': 1} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.347s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51892595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c9adc9-06b9-4dda-b2f0-6e29d062ad99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:26Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce44993-b40f-4646-98ca-bcf4031ea59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b32acf-71fc-427d-8e61-6160cedee734', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 1073741824 Sep 22 18:39:26 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56055349-a5bc-4263-8117-8c5857e2ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Volume volume-d4b32acf-71fc-427d-8e61-6160cedee734 (d4b32acf-71fc-427d-8e61-6160cedee734): created successfully Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56055349-a5bc-4263-8117-8c5857e2ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Flow 'volume_create_manager' (8f9b0194-7010-4ffb-94fb-c17544577bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a07f1365-cbd6-4b2d-a973-16ce0d42dac9 tempest-VolumeDependencyTests-651922866 None] Created volume successfully. Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (5b8b3742-6857-4338-a8d9-283f12cfd9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446d1eef-5922-4246-9c13-b518331a62a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446d1eef-5922-4246-9c13-b518331a62a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011774161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b70a81-dd43-4952-afbb-fdd276c7c2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:27Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7399cbd0-c284-43e0-82d8-c94a2084c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7399cbd0-c284-43e0-82d8-c94a2084c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076e2f04-dd67-4ff9-b8be-e7db35cd92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076e2f04-dd67-4ff9-b8be-e7db35cd92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b70a81-dd43-4952-afbb-fdd276c7c2be', 'volume_name': 'volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcdbc1a-b915-4a8c-8878-a474bb7ffbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcdbc1a-b915-4a8c-8878-a474bb7ffbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edba4802-6802-47e3-92d4-97b1a00b05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume f7b70a81-dd43-4952-afbb-fdd276c7c2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be', 'volume_size': 1} Sep 22 18:39:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:27 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 1073741824" returned: 0 in 0.723s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:27 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 Sep 22 18:39:27 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (85313e82-60db-4df1-9c38-c11bc15180b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32313923-0c2a-458f-a2e9-ca9c32263c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32313923-0c2a-458f-a2e9-ca9c32263c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571693271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62d66b3-6c9a-4f75-8005-79d15b7e8516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e497ed7a-6a5a-421a-b5e1-62b3a5664fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e497ed7a-6a5a-421a-b5e1-62b3a5664fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab183b3-f6b3-474c-bf7d-9430a0a95169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab183b3-f6b3-474c-bf7d-9430a0a95169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62d66b3-6c9a-4f75-8005-79d15b7e8516', 'volume_name': 'volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910e73f4-eb75-48bf-9e33-71d8db47b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910e73f4-eb75-48bf-9e33-71d8db47b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e997d73-aada-45ce-87aa-27be209e064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume d62d66b3-6c9a-4f75-8005-79d15b7e8516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516', 'volume_size': 1} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Flow 'volume_create_manager' (36a5cd65-6749-49dc-9548-2404fa266968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509a348-bb02-4195-9645-7d2d79102ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509a348-bb02-4195-9645-7d2d79102ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1083699911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ffbf27-814c-421f-bb7a-e66415c02601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040f2dc929b4443b4ac4ed080124cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='38b6f44991e34ae58d9ab27f1357085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a059c5f7-f923-48d1-9bfd-a9fd870c1eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a059c5f7-f923-48d1-9bfd-a9fd870c1eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e5128-fc89-46c3-a7f6-93429f1c06a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e5128-fc89-46c3-a7f6-93429f1c06a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ffbf27-814c-421f-bb7a-e66415c02601', 'volume_name': 'volume-83ffbf27-814c-421f-bb7a-e66415c02601', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e188c8bf-9ff8-4322-8b14-2e808432d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e188c8bf-9ff8-4322-8b14-2e808432d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef7ae92-5f84-49a9-9358-a1c66ef47de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Volume 83ffbf27-814c-421f-bb7a-e66415c02601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ffbf27-814c-421f-bb7a-e66415c02601', 'volume_size': 1} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" returned: 0 in 0.461s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647343034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea3c906-525f-48da-be4d-a3b2e10adffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:26Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume bea3c906-525f-48da-be4d-a3b2e10adffe {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:27 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140b721-eddb-4991-80a8-2f296aaa7984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae31f298-15fe-4236-b95b-48495577ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:27 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe 1073741824 Sep 22 18:39:27 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:27 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 (d4c9adc9-06b9-4dda-b2f0-6e29d062ad99): created successfully Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae31f298-15fe-4236-b95b-48495577ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (bef20f59-dc6c-4e6d-ae78-5e63d194d10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:28 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6182697a-824a-4d3a-bffc-c4a6b4dedf20 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (1fcdb7ab-885e-4d71-8b91-b047bbe93df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ab5a9-db96-42ff-a002-ff425d6cce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ab5a9-db96-42ff-a002-ff425d6cce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79218097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9040fe53-8a94-4afb-aef6-d31c825169ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad12171-92c7-4d7d-b26e-f27bf3c3c56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad12171-92c7-4d7d-b26e-f27bf3c3c56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d388af-1bf7-40b2-bbae-c5e4577352ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d388af-1bf7-40b2-bbae-c5e4577352ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9040fe53-8a94-4afb-aef6-d31c825169ab', 'volume_name': 'volume-9040fe53-8a94-4afb-aef6-d31c825169ab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f440d806-a314-4477-9d31-68d47c0949c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f440d806-a314-4477-9d31-68d47c0949c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dd5748-67de-4ed7-b82d-46408a49c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume 9040fe53-8a94-4afb-aef6-d31c825169ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9040fe53-8a94-4afb-aef6-d31c825169ab', 'volume_size': 1} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:28 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe 1073741824" returned: 0 in 0.600s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:28 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe Sep 22 18:39:28 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:28 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2011774161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b70a81-dd43-4952-afbb-fdd276c7c2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:27Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume f7b70a81-dd43-4952-afbb-fdd276c7c2be {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:28 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace5938-7c54-4312-ae31-2de954fe804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea3c906-525f-48da-be4d-a3b2e10adffe', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b58a2-02aa-4ab6-958d-30f52ccd36cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:28 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be 1073741824 Sep 22 18:39:28 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-bea3c906-525f-48da-be4d-a3b2e10adffe (bea3c906-525f-48da-be4d-a3b2e10adffe): created successfully Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069b58a2-02aa-4ab6-958d-30f52ccd36cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (43e70343-20ba-4431-98ee-3a691510ae74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:28 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3fb88a4a-297c-4865-b3a4-0ba21a962e83 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:29 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be 1073741824" returned: 0 in 0.467s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:29 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be Sep 22 18:39:29 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:29 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.831s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571693271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62d66b3-6c9a-4f75-8005-79d15b7e8516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume d62d66b3-6c9a-4f75-8005-79d15b7e8516 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:29 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edba4802-6802-47e3-92d4-97b1a00b05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b536382-b919-46c8-8240-fe884426c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:29 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 1073741824 Sep 22 18:39:29 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:29 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be (f7b70a81-dd43-4952-afbb-fdd276c7c2be): created successfully Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b536382-b919-46c8-8240-fe884426c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:29 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (5b8b3742-6857-4338-a8d9-283f12cfd9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ab877bb9-557e-401c-9b33-de8461905eb8 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:30 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 1073741824" returned: 0 in 0.523s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:30 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 Sep 22 18:39:30 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:30 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.513s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1083699911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ffbf27-814c-421f-bb7a-e66415c02601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040f2dc929b4443b4ac4ed080124cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='38b6f44991e34ae58d9ab27f1357085d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Creating volume 83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:30 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e997d73-aada-45ce-87aa-27be209e064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:30 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 1073741824 Sep 22 18:39:30 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c3673a-566b-4d8c-829c-29ce1ee93256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:30 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 (d62d66b3-6c9a-4f75-8005-79d15b7e8516): created successfully Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c3673a-566b-4d8c-829c-29ce1ee93256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (85313e82-60db-4df1-9c38-c11bc15180b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:30 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-849462d5-9794-4b55-af91-0a5e3d2274c2 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:30 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 1073741824" returned: 0 in 0.480s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:30 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 Sep 22 18:39:30 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:31 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601" returned: 0 in 0.289s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.004s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79218097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9040fe53-8a94-4afb-aef6-d31c825169ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78aabc1ea2144d97b844776f2ff4fd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:28Z,use_quota=True,user_id='af16b469cff544a6aab469a1c0cf38a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Creating volume 9040fe53-8a94-4afb-aef6-d31c825169ab {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:31 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef7ae92-5f84-49a9-9358-a1c66ef47de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ffbf27-814c-421f-bb7a-e66415c02601', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:31 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab 1073741824 Sep 22 18:39:31 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22857fc7-5687-40a3-ade5-d6c73ffe70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:31 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Volume volume-83ffbf27-814c-421f-bb7a-e66415c02601 (83ffbf27-814c-421f-bb7a-e66415c02601): created successfully Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22857fc7-5687-40a3-ade5-d6c73ffe70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Flow 'volume_create_manager' (36a5cd65-6749-49dc-9548-2404fa266968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fe3c3c78-5939-42e3-9715-af5a561eecf5 tempest-CinderUnicodeTest-1522468798 None] Created volume successfully. Sep 22 18:39:31 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab 1073741824" returned: 0 in 0.484s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:31 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab Sep 22 18:39:31 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:32 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab" returned: 0 in 0.289s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.817s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dd5748-67de-4ed7-b82d-46408a49c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9040fe53-8a94-4afb-aef6-d31c825169ab', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ce621-d70a-4949-9a72-806aaec44bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Creating offline snapshot b5a5431d-48bd-44db-923f-d04ac8e61c7d of volume d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:39:32 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Volume volume-9040fe53-8a94-4afb-aef6-d31c825169ab (9040fe53-8a94-4afb-aef6-d31c825169ab): created successfully Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ce621-d70a-4949-9a72-806aaec44bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Flow 'volume_create_manager' (1fcdb7ab-885e-4d71-8b91-b047bbe93df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c46fcdd-3c1f-4ec6-aa0f-1262e8e43263]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d71bee63-2a7d-4717-82d0-38040f796672 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created volume successfully. Sep 22 18:39:32 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:32 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-9040fe53-8a94-4afb-aef6-d31c825169ab-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-9040fe53-8a94-4afb-aef6-d31c825169ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-9040fe53-8a94-4afb-aef6-d31c825169ab" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-9040fe53-8a94-4afb-aef6-d31c825169ab" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:32 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.420s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[97390578-6b35-470f-98aa-2f11c64a859a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:32 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d 1G Sep 22 18:39:32 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:32 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab Sep 22 18:39:32 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:32 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab" returned: 0 in 0.431s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab Sep 22 18:39:33 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:33 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d 1G" returned: 0 in 0.514s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b32acf-71fc-427d-8e61-6160cedee734 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b32acf-71fc-427d-8e61-6160cedee734 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:33 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:33 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-9040fe53-8a94-4afb-aef6-d31c825169ab" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-9040fe53-8a94-4afb-aef6-d31c825169ab" released by "delete_volume" :: held 0.767s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['564319db-3a64-4a93-91f2-52620c771e69', 'f1615e30-6840-4510-aca6-b2847b72a2e3', 'e672aee9-7483-4881-8e54-51a644e676df', 'e40737a9-7411-460e-be58-234a8fc8d60f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b32acf-71fc-427d-8e61-6160cedee734 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:33 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d is being set with open permissions: ugo+rw Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:33 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:33 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:33 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-d62d66b3-6c9a-4f75-8005-79d15b7e8516-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-d62d66b3-6c9a-4f75-8005-79d15b7e8516-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-d62d66b3-6c9a-4f75-8005-79d15b7e8516" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-d62d66b3-6c9a-4f75-8005-79d15b7e8516" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01c139-99f0-43a3-b46d-054973d29a6e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.346s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:33 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.322s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:33 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:33 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ce1166dc-5bf6-46ee-88a5-e03b5f64d136 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-9040fe53-8a94-4afb-aef6-d31c825169ab-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:33 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info Sep 22 18:39:33 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:33 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 Sep 22 18:39:33 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:34 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:34 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info is being set with open permissions: ugo+rw Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:34 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info Sep 22 18:39:34 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:34 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516" returned: 0 in 0.428s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:34 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516 Sep 22 18:39:34 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:34 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:34 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d62d66b3-6c9a-4f75-8005-79d15b7e8516" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.info" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.485s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-d62d66b3-6c9a-4f75-8005-79d15b7e8516" released by "delete_volume" :: held 0.755s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Creating offline snapshot dd9aae33-8998-444d-9426-3995a2e3ebe9 of volume 83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:39:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-94e1365f-db9a-451d-9b6c-6094ce53ce9b tempest-VolumeDependencyTests-651922866 None] Create snapshot completed successfully Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa1df1-7afa-44f6-91af-2782d2900869]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['cd6869eb-cf64-4a90-ae84-09b531b508ac', 'bfdf1de8-2312-4d99-b89a-ac08a4ed3622', 'b5076111-ecfd-4d32-9473-a467aae36a41', '6a0f5499-2fb3-4750-96b0-1bb074ec2c6b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:34 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 Sep 22 18:39:34 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:34 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:34 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-f7b70a81-dd43-4952-afbb-fdd276c7c2be-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-f7b70a81-dd43-4952-afbb-fdd276c7c2be-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-f7b70a81-dd43-4952-afbb-fdd276c7c2be" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-f7b70a81-dd43-4952-afbb-fdd276c7c2be" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c31688-d6dc-42ae-8b2e-40eff05990ff]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:34 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.336s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:35 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f8b9bc8d-6912-4877-8a6b-4240f40cbc53 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-d62d66b3-6c9a-4f75-8005-79d15b7e8516-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:35 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601" returned: 0 in 0.527s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:35 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 1G Sep 22 18:39:35 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:35 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be Sep 22 18:39:35 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:35 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be" returned: 0 in 0.443s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:35 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be Sep 22 18:39:35 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:35 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 1G" returned: 0 in 0.486s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbf27-814c-421f-bb7a-e66415c02601 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:35 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbf27-814c-421f-bb7a-e66415c02601 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 Sep 22 18:39:35 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:35 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f7b70a81-dd43-4952-afbb-fdd276c7c2be" returned: 0 in 0.320s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-f7b70a81-dd43-4952-afbb-fdd276c7c2be" released by "delete_volume" :: held 0.821s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['8c8e705d-c9c0-415f-b04a-3023d0994622', 'af9f8ed1-99bd-41ef-be72-018d4a9052f0', '4e96082d-5b74-44e4-b9de-7c94908c9b7c', 'a8a4f521-f5ff-4c36-bf2e-2193592a8d0e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:35 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbf27-814c-421f-bb7a-e66415c02601 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9" returned: 0 in 0.423s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:35 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 is being set with open permissions: ugo+rw Sep 22 18:39:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:36 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:36 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:36 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 Sep 22 18:39:36 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-bea3c906-525f-48da-be4d-a3b2e10adffe-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-bea3c906-525f-48da-be4d-a3b2e10adffe-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Flow 'volume_create_manager' (9895f5dc-2337-4363-8ef9-aee71857e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55fb9ae-45e5-4320-84f5-2f651291444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55fb9ae-45e5-4320-84f5-2f651291444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-779540427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29a73f4-d30a-443b-be36-c9805b7376c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8637c16221471984f2a06206723f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5a5431d-48bd-44db-923f-d04ac8e61c7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:39:36Z,use_quota=True,user_id='d8a0c3111aa64db6ad5a0e0ac6c1cace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a4305-8153-4ed2-b1ad-11eecb5f3d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a4305-8153-4ed2-b1ad-11eecb5f3d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ceb39d8-aa0a-4a23-842a-6f5528011b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ceb39d8-aa0a-4a23-842a-6f5528011b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f29a73f4-d30a-443b-be36-c9805b7376c0', 'volume_name': 'volume-f29a73f4-d30a-443b-be36-c9805b7376c0', 'volume_size': 1, 'snapshot_id': 'b5a5431d-48bd-44db-923f-d04ac8e61c7d'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c1fd0-0393-46c5-b7f1-8a67a4d7df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:36 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c1fd0-0393-46c5-b7f1-8a67a4d7df3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50866b2a-da34-4a1e-a830-1abd54e11c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:36 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Volume f29a73f4-d30a-443b-be36-c9805b7376c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f29a73f4-d30a-443b-be36-c9805b7376c0', 'volume_size': 1, 'snapshot_id': 'b5a5431d-48bd-44db-923f-d04ac8e61c7d'} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-bea3c906-525f-48da-be4d-a3b2e10adffe" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9" returned: 0 in 0.352s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-bea3c906-525f-48da-be4d-a3b2e10adffe" acquired by "delete_volume" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02e1b3-b1e2-430c-8f5a-07db2d8fa4f3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:36 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:36 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info Sep 22 18:39:36 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.484s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b5f0da8d-73a2-439c-bd28-6bcdf74860f4 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-f7b70a81-dd43-4952-afbb-fdd276c7c2be-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:36 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe Sep 22 18:39:36 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:36 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info" returned: 0 in 0.319s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:36 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info is being set with open permissions: ugo+rw Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:36 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info Sep 22 18:39:36 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:36 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe" returned: 0 in 0.431s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:36 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe Sep 22 18:39:36 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:37 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.info" returned: 0 in 0.306s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.715s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d-f29a73f4-d30a-443b-be36-c9805b7376c0" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d-f29a73f4-d30a-443b-be36-c9805b7376c0" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Creating volume f29a73f4-d30a-443b-be36-c9805b7376c0 from snapshot b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:37 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-bea3c906-525f-48da-be4d-a3b2e10adffe" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-633b62e4-b53e-43ec-a081-fbd82f611a35 tempest-CinderUnicodeTest-1522468798 None] Create snapshot completed successfully Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] snapshot: b5a5431d-48bd-44db-923f-d04ac8e61c7d, volume: f29a73f4-d30a-443b-be36-c9805b7376c0, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-bea3c906-525f-48da-be4d-a3b2e10adffe" released by "delete_volume" :: held 0.778s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563151f-dbcd-485b-b193-5b854827a4d6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['7df4715b-0643-4f77-b9f3-009fa5d711b1', 'efbb7718-472c-41ce-993f-4045e1f4b5c1', '882bbb44-2d87-40e5-a794-1b4e385cd24e', 'f00e0f7a-9927-443c-b03b-6149e4c0eeee'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:37 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:37 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:37 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:37 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-dd9aae33-8998-444d-9426-3995a2e3ebe9-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-dd9aae33-8998-444d-9426-3995a2e3ebe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-quobyte-dd9aae33-8998-444d-9426-3995a2e3ebe9" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-dd9aae33-8998-444d-9426-3995a2e3ebe9" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Deleting offline snapshot dd9aae33-8998-444d-9426-3995a2e3ebe9 of volume 83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] snapshot_file for this snap is: volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:39:37 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.483s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b32acf-71fc-427d-8e61-6160cedee734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3e70e-d901-4603-ae2d-ba1e2a2aa60f]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:37 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4311ee3-fae5-489a-9b82-cd2113f13ed6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" acquired by "delete_volume" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:37 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 Sep 22 18:39:37 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b150f7b3-c405-43d2-b4eb-0e168708c113 tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-bea3c906-525f-48da-be4d-a3b2e10adffe-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f37e668-928a-4d4e-a7af-492751d0220b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:37 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:37 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:37 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 Sep 22 18:39:37 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:38 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9" returned: 0 in 0.490s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ffbf27-814c-421f-bb7a-e66415c02601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:39:38 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.496s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d396d-9471-49ef-9a8c-d8150ff1fdf3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:38 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 Sep 22 18:39:38 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:38 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" returned: 0 in 0.472s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:38 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 Sep 22 18:39:38 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:38 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99 Sep 22 18:39:38 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:38 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" returned: 0 in 0.317s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99" released by "delete_volume" :: held 0.862s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:38 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601" returned: 0 in 0.500s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['bde2e61b-22eb-4acd-9025-3ec06fc4ff0f', '8f4fdfe2-47d5-4840-8b26-a3747e71ea28', '90db5a2e-6c21-4732-a128-d36273d6f76c', 'de7fba29-4c36-4126-bef4-022b540fb031'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:38 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 Sep 22 18:39:38 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:38 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:38 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:39 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.410s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-21d6af9b-4c8b-4d71-8970-d868768e643a tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-d4c9adc9-06b9-4dda-b2f0-6e29d062ad99-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:39 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9" returned: 0 in 0.824s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:39 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9 Sep 22 18:39:39 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-02d79439-f61e-41d5-b063-6e9ab3373a82-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-02d79439-f61e-41d5-b063-6e9ab3373a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-02d79439-f61e-41d5-b063-6e9ab3373a82" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-02d79439-f61e-41d5-b063-6e9ab3373a82" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleting offline snapshot 02d79439-f61e-41d5-b063-6e9ab3373a82 of volume 0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:39:40 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] snapshot_file for this snap is: volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601.dd9aae33-8998-444d-9426-3995a2e3ebe9" returned: 0 in 0.696s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9bc9f-17a7-4ff8-911e-5af8a4dc5072]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-dd9aae33-8998-444d-9426-3995a2e3ebe9" released by "_delete_snapshot" :: held 2.738s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" released by "delete_snapshot" :: held 2.809s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Created reservations ['03303946-3368-4e85-827d-a3d0e07e2c6b', '5d9216aa-b743-4b95-b353-39eba79dba25', 'c1e10413-f6f9-43b5-9474-b3e9a033834a', 'd5eb660a-362f-42cf-a4a2-8e941b6cc41e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:40 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 Sep 22 18:39:40 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:40 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Delete snapshot completed successfully. Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d225dfb6-9df0-4495-b736-cd99dcdebaf7 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-dd9aae33-8998-444d-9426-3995a2e3ebe9-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-83ffbf27-814c-421f-bb7a-e66415c02601-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-83ffbf27-814c-421f-bb7a-e66415c02601-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d279b5-ff7e-4398-a1e8-3b452c868a83]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:41 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82" returned: 0 in 0.918s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c79e94-8da8-453f-af20-f79adac2a373]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:41 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 Sep 22 18:39:41 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:41 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f Sep 22 18:39:41 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:41 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601" returned: 0 in 0.792s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:42 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601 Sep 22 18:39:42 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:42 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f" returned: 0 in 0.866s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:42 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 Sep 22 18:39:42 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:42 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-83ffbf27-814c-421f-bb7a-e66415c02601" returned: 0 in 0.718s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-83ffbf27-814c-421f-bb7a-e66415c02601" released by "delete_volume" :: held 1.687s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:42 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Created reservations ['8171fcc5-f27d-4b86-9c39-5a21b3545ed4', 'e2935874-2a87-464e-809d-ad17b966f532', '5fc89518-3d30-4aa7-8e40-b34e57c8e765', '85d365dc-93d8-42c3-9454-4b1dfef865d2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:43 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:43 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:43 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82" returned: 0 in 1.099s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:43 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82 Sep 22 18:39:43 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-ee7a77ac-53d6-4d2f-9b55-f542cffa035f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-ee7a77ac-53d6-4d2f-9b55-f542cffa035f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "cinder-quobyte-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" acquired by "delete_volume" :: waited 0.039s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:43 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.595s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Deleted volume successfully. Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e1d702-50bb-48a9-a65b-b77f268ff4ec]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4af24ca8-85a1-4899-ac4c-95122be512aa tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-83ffbf27-814c-421f-bb7a-e66415c02601-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:43 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f Sep 22 18:39:43 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:43 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f.02d79439-f61e-41d5-b063-6e9ab3373a82" returned: 0 in 0.681s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-02d79439-f61e-41d5-b063-6e9ab3373a82" released by "_delete_snapshot" :: held 3.972s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" released by "delete_snapshot" :: held 4.029s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['f4822c2b-2069-4bc6-a696-04309993d118', '6b2e6fb9-f82f-473e-a4f1-591ba6bb8435', 'c6c687b4-ba82-4d5a-bde8-f7b4ea1eb18a', '64f92cc4-7873-43ee-80f5-6bbaae4099a9'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:44 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Delete snapshot completed successfully. Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7191504d-e2a9-484a-94a5-12f3fc066b5d tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-02d79439-f61e-41d5-b063-6e9ab3373a82-delete_snapshot" released by "delete_snapshot" :: held 4.484s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:44 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" returned: 0 in 0.979s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:44 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f Sep 22 18:39:44 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:45 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" returned: 0 in 0.614s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-quobyte-ee7a77ac-53d6-4d2f-9b55-f542cffa035f" released by "delete_volume" :: held 1.722s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Created reservations ['7853f44b-4efc-41b5-ae7f-26765efbb20e', '3fbaa81f-cd13-4397-878a-0ced291ccd80', '00a3d254-083e-417b-85d3-71b6e353b030', 'bc86c5ed-df7c-4f15-9fd0-e1e4cea69912'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:45 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:45 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-0fdc4978-1e81-4dcb-b015-09b21bf9380f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-0fdc4978-1e81-4dcb-b015-09b21bf9380f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" acquired by "delete_volume" :: waited 0.051s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:46 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9bf81-103b-455d-a2f5-64c0bd6fb2ae]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:46 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.651s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:46 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Deleted volume successfully. Sep 22 18:39:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-789253a6-e742-4bc8-8747-bc8232bc2335 tempest-CinderUnicodeTest-1522468798 None] Lock "cinder-ee7a77ac-53d6-4d2f-9b55-f542cffa035f-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:46 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f Sep 22 18:39:46 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:47 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f" returned: 0 in 1.043s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:47 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f Sep 22 18:39:47 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:47 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0fdc4978-1e81-4dcb-b015-09b21bf9380f" returned: 0 in 0.591s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:47 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-quobyte-0fdc4978-1e81-4dcb-b015-09b21bf9380f" released by "delete_volume" :: held 1.823s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:47 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Created reservations ['8e249be1-8a4d-4267-abcd-1a7c65019a8c', '5fc5d714-d355-45f3-b1ee-7553e9b56562', '5dea111b-b2c1-4964-8b5d-adf5d7874833', '3e2af4b8-2d15-4ed7-b82c-279941ad37e7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:48 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:48 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:48 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0" returned: 0 in 10.144s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734, size 1024.00 MB, duration 10.15 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:39:48 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Converted 1024.00 MB image at 100.93 MB/s Sep 22 18:39:48 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 is being set with open permissions: ugo+rw Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:48 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 Sep 22 18:39:48 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:48 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:48 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:48 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.502s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Deleted volume successfully. Sep 22 18:39:48 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0" returned: 0 in 0.417s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-40a499a0-3263-436a-88e7-2fd99695ddce tempest-CreateVolumesFromSnapshotTest-1552416850 None] Lock "cinder-0fdc4978-1e81-4dcb-b015-09b21bf9380f-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" released by "_copy_volume_from_snapshot" :: held 11.659s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d-f29a73f4-d30a-443b-be36-c9805b7376c0" released by "_create_volume_from_snapshot" :: held 11.752s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.783s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50866b2a-da34-4a1e-a830-1abd54e11c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29a73f4-d30a-443b-be36-c9805b7376c0', 'volume_size': 1, 'snapshot_id': 'b5a5431d-48bd-44db-923f-d04ac8e61c7d'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b731c2-4823-4569-92dd-c9b040dca4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:39:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Volume volume-f29a73f4-d30a-443b-be36-c9805b7376c0 (f29a73f4-d30a-443b-be36-c9805b7376c0): created successfully Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b731c2-4823-4569-92dd-c9b040dca4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:39:48 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Flow 'volume_create_manager' (9895f5dc-2337-4363-8ef9-aee71857e333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:39:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:39:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-90354a0a-124d-44d8-807f-0e6c2f2aaabd tempest-VolumeDependencyTests-651922866 None] Created volume successfully. Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-b5a5431d-48bd-44db-923f-d04ac8e61c7d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-b5a5431d-48bd-44db-923f-d04ac8e61c7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Deleting offline snapshot b5a5431d-48bd-44db-923f-d04ac8e61c7d of volume d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] snapshot_file for this snap is: volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0b604-54c1-4d26-a130-71a1de445a25]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:49 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:49 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:49 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.441s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b32acf-71fc-427d-8e61-6160cedee734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7335693-3423-4081-ac69-5a32ba8fc0b9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:49 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:49 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:50 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.591s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:50 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:50 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:50 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.455s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:50 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d Sep 22 18:39:50 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:51 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734.b5a5431d-48bd-44db-923f-d04ac8e61c7d" returned: 0 in 0.378s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:UPDATE=253,cinder:SELECT=183,cinder:INSERT=76,cinder:DELETE=23 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=190,cinder:UPDATE=258,cinder:INSERT=61,cinder:DELETE=24 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-b5a5431d-48bd-44db-923f-d04ac8e61c7d" released by "_delete_snapshot" :: held 2.044s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" released by "delete_snapshot" :: held 2.100s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Created reservations ['2630d0a2-6871-4c28-adb6-bb8af3a6421d', 'c6fef2ad-bb84-4913-bb12-8c2cc744a4f7', 'b2a0c72d-3fb1-49fa-8cab-ee4489230b8b', '87bcc0f4-dd1b-402a-a37c-09f7cd28dfd0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:51 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Delete snapshot completed successfully. Sep 22 18:39:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-4c42f273-4bb7-4208-82c3-72250ef8ce0a tempest-VolumeDependencyTests-651922866 None] Lock "cinder-b5a5431d-48bd-44db-923f-d04ac8e61c7d-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-d4b32acf-71fc-427d-8e61-6160cedee734-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "cinder-d4b32acf-71fc-427d-8e61-6160cedee734-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3bfbe8-f83e-4031-97b4-4586dfc9b835]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:52 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:52 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:52 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.423s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:52 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734 Sep 22 18:39:52 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:53 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-d4b32acf-71fc-427d-8e61-6160cedee734" returned: 0 in 0.301s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-d4b32acf-71fc-427d-8e61-6160cedee734" released by "delete_volume" :: held 0.809s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Created reservations ['7279adbb-29b8-48e4-8483-e75f1263a384', 'fb91fe39-6c4e-493a-b1b5-823326f6235a', '12bd0189-e7b3-424f-941c-e89837f6eb95', 'cfd74e80-b749-48f4-b8cf-7ea0069f0d39'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:53 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:53 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-f29a73f4-d30a-443b-be36-c9805b7376c0-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "cinder-f29a73f4-d30a-443b-be36-c9805b7376c0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Acquiring lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400f0e7-6a61-4272-84ed-24b1acdf29e3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:39:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:53 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.478s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Deleted volume successfully. Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3b1142e5-c9c6-49d6-b523-79ea892c32cc tempest-VolumeDependencyTests-651922866 None] Lock "cinder-d4b32acf-71fc-427d-8e61-6160cedee734-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:54 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 Sep 22 18:39:54 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:54 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0" returned: 0 in 0.521s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:54 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0 Sep 22 18:39:54 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:54 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-f29a73f4-d30a-443b-be36-c9805b7376c0" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "cinder-quobyte-f29a73f4-d30a-443b-be36-c9805b7376c0" released by "delete_volume" :: held 0.966s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Created reservations ['f7ca6319-6b93-410e-a7e6-60c2dd46a2b4', '5f326c2c-774a-430c-af94-63b07ef92796', '15d7fa48-482a-409e-bb0a-375046d054bc', '0667a23d-66de-48b8-adad-20d0e0fb98e8'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:39:55 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:39:55 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:39:55 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:39:55 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Deleted volume successfully. Sep 22 18:39:55 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-242118ae-867f-4465-8254-fd737c13b1a0 tempest-VolumeDependencyTests-651922866 None] Lock "cinder-f29a73f4-d30a-443b-be36-c9805b7376c0-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c5bc325b-0ec6-49aa-bc5e-fbc48c336f80 tempest-ProjectAdminTests-2724265 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5557746887207, 'free_capacity_gb': 1775.5557746887207, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (a3aeb9df-59d7-460d-806e-7807fbb4ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644314df-ffc8-4a36-8a51-5a04cff14dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644314df-ffc8-4a36-8a51-5a04cff14dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688264642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97307d61-f8d3-4652-8bc9-81abf48982c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:02Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c34da-ad91-46e5-8324-186d1a600009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c34da-ad91-46e5-8324-186d1a600009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726584b2-b8f4-43fb-bd77-0158ee6550cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726584b2-b8f4-43fb-bd77-0158ee6550cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97307d61-f8d3-4652-8bc9-81abf48982c6', 'volume_name': 'volume-97307d61-f8d3-4652-8bc9-81abf48982c6', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c51863e-165c-4def-ae5a-4e8aa87262af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c51863e-165c-4def-ae5a-4e8aa87262af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f52b36-b679-4a18-8e83-5ad1aa63f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Volume 97307d61-f8d3-4652-8bc9-81abf48982c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97307d61-f8d3-4652-8bc9-81abf48982c6', 'volume_size': 1} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688264642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97307d61-f8d3-4652-8bc9-81abf48982c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:02Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Creating volume 97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:02 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:02 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 1073741824 Sep 22 18:40:02 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:02 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 1073741824" returned: 0 in 0.588s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:02 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 Sep 22 18:40:02 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:02 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6" returned: 0 in 0.304s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f52b36-b679-4a18-8e83-5ad1aa63f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97307d61-f8d3-4652-8bc9-81abf48982c6', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78dee363-7293-4742-afc1-cb6506853d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Volume volume-97307d61-f8d3-4652-8bc9-81abf48982c6 (97307d61-f8d3-4652-8bc9-81abf48982c6): created successfully Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78dee363-7293-4742-afc1-cb6506853d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (a3aeb9df-59d7-460d-806e-7807fbb4ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:03 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-31a4634d-8951-4f7f-9542-6d2827b480f4 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot d5dcc9d7-11b8-4773-8145-16c18d81f0e7 of volume 97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52529b2-5182-4681-97ff-b85e282639b0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:04 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 Sep 22 18:40:04 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:05 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6" returned: 0 in 0.441s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:05 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 1G Sep 22 18:40:05 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Flow 'volume_create_manager' (8eb63ef0-2e71-4bad-b141-2e7857e037e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af4c44c-84b9-480b-b165-485d78bba867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af4c44c-84b9-480b-b165-485d78bba867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1471381566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd91788-164b-4b05-b711-09df9718ea4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd48e97e0454e34b6511fb58f878f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:05Z,use_quota=True,user_id='676ad75e748b4466a4a6c499ab1f777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f892cc-f43e-4f6e-be29-dede491c02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f892cc-f43e-4f6e-be29-dede491c02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf9dba5-dbd6-46ae-a1e7-1d94100916c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf9dba5-dbd6-46ae-a1e7-1d94100916c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd91788-164b-4b05-b711-09df9718ea4f', 'volume_name': 'volume-8fd91788-164b-4b05-b711-09df9718ea4f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b849280f-8723-44ca-bb4f-831d3f047f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b849280f-8723-44ca-bb4f-831d3f047f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369cb1b2-59b0-494b-8975-30b57f660302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Volume 8fd91788-164b-4b05-b711-09df9718ea4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd91788-164b-4b05-b711-09df9718ea4f', 'volume_size': 1} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:05 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 1G" returned: 0 in 0.512s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97307d61-f8d3-4652-8bc9-81abf48982c6 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:05 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97307d61-f8d3-4652-8bc9-81abf48982c6 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 Sep 22 18:40:05 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:05 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97307d61-f8d3-4652-8bc9-81abf48982c6 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7" returned: 0 in 0.300s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:05 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 is being set with open permissions: ugo+rw Sep 22 18:40:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:05 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 Sep 22 18:40:05 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:06 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info Sep 22 18:40:06 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:06 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:06 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info is being set with open permissions: ugo+rw Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:06 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info Sep 22 18:40:06 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:06 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.info" returned: 0 in 0.257s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1471381566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd91788-164b-4b05-b711-09df9718ea4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd48e97e0454e34b6511fb58f878f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:05Z,use_quota=True,user_id='676ad75e748b4466a4a6c499ab1f777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Creating volume 8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:06 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:06 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f 1073741824 Sep 22 18:40:06 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-36891f90-b81b-43a3-9bed-dd61ad07b9b9 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:07 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f 1073741824" returned: 0 in 0.465s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:07 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:07 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:07 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369cb1b2-59b0-494b-8975-30b57f660302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd91788-164b-4b05-b711-09df9718ea4f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759bcac7-1994-4f25-bdde-1a799f59079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Volume volume-8fd91788-164b-4b05-b711-09df9718ea4f (8fd91788-164b-4b05-b711-09df9718ea4f): created successfully Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759bcac7-1994-4f25-bdde-1a799f59079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Flow 'volume_create_manager' (8eb63ef0-2e71-4bad-b141-2e7857e037e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7e123f07-c691-4a04-9dd9-7a073d4d3ea8 tempest-SnapshotDependencyTests-589468051 None] Created volume successfully. Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-d5dcc9d7-11b8-4773-8145-16c18d81f0e7-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-d5dcc9d7-11b8-4773-8145-16c18d81f0e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-d5dcc9d7-11b8-4773-8145-16c18d81f0e7" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-d5dcc9d7-11b8-4773-8145-16c18d81f0e7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot d5dcc9d7-11b8-4773-8145-16c18d81f0e7 of volume 97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec3305-3058-46bf-9e46-2505f3c2af2b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:07 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 Sep 22 18:40:07 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:08 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97307d61-f8d3-4652-8bc9-81abf48982c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7156843f-7d50-4641-bc62-6222497ee307]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:08 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 Sep 22 18:40:08 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:08 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6" returned: 0 in 0.379s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:08 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 Sep 22 18:40:08 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Creating offline snapshot ca621cfb-936b-47ce-b39e-ef563e16023d of volume 8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebbea6d-7e69-4a78-8fb9-3a23cd47cec3]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:09 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7" returned: 0 in 0.439s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:09 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7 Sep 22 18:40:09 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:09 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:09 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:09 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6.d5dcc9d7-11b8-4773-8145-16c18d81f0e7" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-d5dcc9d7-11b8-4773-8145-16c18d81f0e7" released by "_delete_snapshot" :: held 1.579s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" released by "delete_snapshot" :: held 1.606s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:09 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.436s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:09 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d 1G Sep 22 18:40:09 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Created reservations ['99738a9e-fa6b-48ba-a32f-356c32727cae', '7c56cd1e-294f-4c2b-b6bd-1c5720bea50a', '6a311ad0-fedd-4678-9734-7d9ca472c77a', '670d0fb7-480f-45d0-b72a-a5149caaca18'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f56818f5-ca2c-40ea-8f60-aa4fd7cccd4f tempest-ProjectMemberTests-80746963 None] Lock "cinder-d5dcc9d7-11b8-4773-8145-16c18d81f0e7-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:09 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-97307d61-f8d3-4652-8bc9-81abf48982c6-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d 1G" returned: 0 in 0.489s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd91788-164b-4b05-b711-09df9718ea4f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "cinder-97307d61-f8d3-4652-8bc9-81abf48982c6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:09 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd91788-164b-4b05-b711-09df9718ea4f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:09 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055496e-7cbd-4663-b732-ea65ac9f7131]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 Sep 22 18:40:10 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd91788-164b-4b05-b711-09df9718ea4f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:10 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d is being set with open permissions: ugo+rw Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:10 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6" returned: 0 in 0.375s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6 Sep 22 18:40:10 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info Sep 22 18:40:10 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-97307d61-f8d3-4652-8bc9-81abf48982c6" returned: 0 in 0.257s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-97307d61-f8d3-4652-8bc9-81abf48982c6" released by "delete_volume" :: held 0.699s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Created reservations ['c1a2b1b6-3f0b-43fa-b738-d453261f6d39', 'c3ea5ab4-031b-4dd3-8407-4a5bf91e794d', 'e1f652b8-0450-4975-b0b3-51c9227de8e6', '78bd789a-d018-481f-b70a-573bff96e6e5'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:10 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info" returned: 0 in 0.257s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:10 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info is being set with open permissions: ugo+rw Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info Sep 22 18:40:10 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:10 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:10 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:11 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.info" returned: 0 in 0.312s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:11 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:40:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-8f691277-15ae-4637-873f-da6cf5445b0e tempest-SnapshotDependencyTests-589468051 None] Create snapshot completed successfully Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-3fb82e66-2032-493d-a587-c3501553386c tempest-ProjectMemberTests-80746963 None] Lock "cinder-97307d61-f8d3-4652-8bc9-81abf48982c6-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (72d7d965-5d09-4e99-899e-0de975526559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229c4ddb-f6b7-4473-96ec-55c52c8bc114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229c4ddb-f6b7-4473-96ec-55c52c8bc114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568527984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae17776-e846-4906-ad8f-75b3c993c4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:12Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2035b57a-427f-41ac-ac2a-a6b4effe2893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2035b57a-427f-41ac-ac2a-a6b4effe2893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb625c1-193a-4da3-a6ba-631f9652b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb625c1-193a-4da3-a6ba-631f9652b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae17776-e846-4906-ad8f-75b3c993c4f9', 'volume_name': 'volume-dae17776-e846-4906-ad8f-75b3c993c4f9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911bdd4a-fb08-4c3f-937b-e811e81363d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911bdd4a-fb08-4c3f-937b-e811e81363d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c29633-a94c-4b9b-8d7a-4d5e82476fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:11 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Volume dae17776-e846-4906-ad8f-75b3c993c4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae17776-e846-4906-ad8f-75b3c993c4f9', 'volume_size': 1} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568527984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae17776-e846-4906-ad8f-75b3c993c4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:12Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Creating volume dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:11 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:11 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 1073741824 Sep 22 18:40:11 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:12 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 1073741824" returned: 0 in 0.464s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:12 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 Sep 22 18:40:12 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:12 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c29633-a94c-4b9b-8d7a-4d5e82476fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae17776-e846-4906-ad8f-75b3c993c4f9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca243d2-aaf0-428c-9eeb-06b24b2af554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Volume volume-dae17776-e846-4906-ad8f-75b3c993c4f9 (dae17776-e846-4906-ad8f-75b3c993c4f9): created successfully Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca243d2-aaf0-428c-9eeb-06b24b2af554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (72d7d965-5d09-4e99-899e-0de975526559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d9d97967-f960-4c3b-8571-a74c796a33c1 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Flow 'volume_create_manager' (e8dcd427-1858-4ab0-bca5-8ad090540d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42a3429-b26b-49df-bba2-d5fcc58687b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42a3429-b26b-49df-bba2-d5fcc58687b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09795c18-7b29-4bee-99a3-162449b12a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd48e97e0454e34b6511fb58f878f1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca621cfb-936b-47ce-b39e-ef563e16023d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:13Z,use_quota=True,user_id='676ad75e748b4466a4a6c499ab1f777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46820f5f-fcd7-4549-a36c-b7ea754e0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46820f5f-fcd7-4549-a36c-b7ea754e0184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13090755-f870-4c1c-b032-fe77d0c83617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13090755-f870-4c1c-b032-fe77d0c83617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09795c18-7b29-4bee-99a3-162449b12a02', 'volume_name': 'volume-09795c18-7b29-4bee-99a3-162449b12a02', 'volume_size': 1, 'snapshot_id': 'ca621cfb-936b-47ce-b39e-ef563e16023d'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10b05e8-3bd9-4781-b0c4-ec5cada072d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10b05e8-3bd9-4781-b0c4-ec5cada072d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a743233f-9413-49b5-9079-fe16b57f3e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Volume 09795c18-7b29-4bee-99a3-162449b12a02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09795c18-7b29-4bee-99a3-162449b12a02', 'volume_size': 1, 'snapshot_id': 'ca621cfb-936b-47ce-b39e-ef563e16023d'} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d-09795c18-7b29-4bee-99a3-162449b12a02" by "_create_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d-09795c18-7b29-4bee-99a3-162449b12a02" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Creating volume 09795c18-7b29-4bee-99a3-162449b12a02 from snapshot ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" by "_copy_volume_from_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] snapshot: ca621cfb-936b-47ce-b39e-ef563e16023d, volume: 09795c18-7b29-4bee-99a3-162449b12a02, {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08fa65-b57e-4db1-a6c4-d897bb794f20]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:13 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:13 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:13 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.376s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd91788-164b-4b05-b711-09df9718ea4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b66a33-4c42-4d5a-b2e6-41a2264b367a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:13 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:13 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:13 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.381s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Creating direct copy from snapshot {{(pid=86046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG cinder.utils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Path /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 not found in is_blk_device check {{(pid=86046) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 22 18:40:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:13 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 Sep 22 18:40:13 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:20 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02" returned: 0 in 6.629s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.image.image_utils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Image conversion details: src /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 {{(pid=86046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 22 18:40:20 devstack cinder-volume[86046]: INFO cinder.image.image_utils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Converted 1024.00 MB image at 154.44 MB/s Sep 22 18:40:20 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 is being set with open permissions: ugo+rw Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:20 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 Sep 22 18:40:20 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:20 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" released by "_copy_volume_from_snapshot" :: held 7.734s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d-09795c18-7b29-4bee-99a3-162449b12a02" released by "_create_volume_from_snapshot" :: held 7.809s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.829s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.819s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot ad1d345c-09fa-4358-8fc4-4a4b3593187d of volume dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a743233f-9413-49b5-9079-fe16b57f3e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09795c18-7b29-4bee-99a3-162449b12a02', 'volume_size': 1, 'snapshot_id': 'ca621cfb-936b-47ce-b39e-ef563e16023d'}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777f8166-6d46-4116-92d0-5602bfe6787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc9047-6f1c-44f7-81a1-5ebe8c9ca1f8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:20 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Volume volume-09795c18-7b29-4bee-99a3-162449b12a02 (09795c18-7b29-4bee-99a3-162449b12a02): created successfully Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777f8166-6d46-4116-92d0-5602bfe6787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:20 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Flow 'volume_create_manager' (e8dcd427-1858-4ab0-bca5-8ad090540d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6e8d39ee-8b64-4a85-a9d2-da7ac86e7ba3 tempest-SnapshotDependencyTests-589468051 None] Created volume successfully. Sep 22 18:40:20 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 Sep 22 18:40:20 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:21 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:21 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d 1G Sep 22 18:40:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d 1G" returned: 0 in 0.365s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae17776-e846-4906-ad8f-75b3c993c4f9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:21 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae17776-e846-4906-ad8f-75b3c993c4f9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d Sep 22 18:40:21 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-ca621cfb-936b-47ce-b39e-ef563e16023d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-ca621cfb-936b-47ce-b39e-ef563e16023d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Deleting offline snapshot ca621cfb-936b-47ce-b39e-ef563e16023d of volume 8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] snapshot_file for this snap is: volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c00dc4-4874-416b-8715-29619786f669]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:21 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae17776-e846-4906-ad8f-75b3c993c4f9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d" returned: 0 in 0.310s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:21 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d is being set with open permissions: ugo+rw Sep 22 18:40:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:21 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d Sep 22 18:40:21 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:21 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:21 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:22 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:22 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info Sep 22 18:40:22 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:22 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd91788-164b-4b05-b711-09df9718ea4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1734f9-fd32-41d6-9e4c-0a4e717cfbb4]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:22 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:22 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:22 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info" returned: 0 in 0.292s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:22 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info is being set with open permissions: ugo+rw Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:22 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info Sep 22 18:40:22 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:22 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.info" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9af6829b-0169-48c8-86bd-b22f1cdf4583 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:22 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.576s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:22 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:22 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:23 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.323s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:23 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d Sep 22 18:40:23 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-ad1d345c-09fa-4358-8fc4-4a4b3593187d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:23 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f.ca621cfb-936b-47ce-b39e-ef563e16023d" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-ad1d345c-09fa-4358-8fc4-4a4b3593187d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-ca621cfb-936b-47ce-b39e-ef563e16023d" released by "_delete_snapshot" :: held 1.664s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" released by "delete_snapshot" :: held 1.687s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-ad1d345c-09fa-4358-8fc4-4a4b3593187d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ad1d345c-09fa-4358-8fc4-4a4b3593187d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot ad1d345c-09fa-4358-8fc4-4a4b3593187d of volume dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb568af-5fe4-4927-a677-07600143962a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Created reservations ['eae76d4e-c062-4dc8-8a71-c4632396dbf9', '3fe4a546-6b3f-4e11-bafb-c4996f1e519d', '4e24ded6-70a1-4f58-85ab-fa5858a5fa04', '69ffe31e-a58f-4eb8-85e1-0be63427b308'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:23 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Delete snapshot completed successfully. Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3bf1687-8504-4747-9366-3345441d809a tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-ca621cfb-936b-47ce-b39e-ef563e16023d-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:23 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d Sep 22 18:40:23 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-8fd91788-164b-4b05-b711-09df9718ea4f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:23 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-8fd91788-164b-4b05-b711-09df9718ea4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d" returned: 0 in 0.438s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae17776-e846-4906-ad8f-75b3c993c4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f33c18-5daf-4b0b-a72e-de109611aa8e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:23 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b294529-a76f-4359-ae64-4496b9ddabf0]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 Sep 22 18:40:24 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:24 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:24 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:24 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9" returned: 0 in 0.412s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d Sep 22 18:40:24 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:24 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.399s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f Sep 22 18:40:24 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:24 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8fd91788-164b-4b05-b711-09df9718ea4f" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-8fd91788-164b-4b05-b711-09df9718ea4f" released by "delete_volume" :: held 0.747s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:24 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d" returned: 0 in 0.424s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d Sep 22 18:40:24 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Created reservations ['7fc9fbff-a651-4c36-a328-cf51019a2911', 'f694d113-95c2-4d38-a493-76a7c1cf2179', 'c6a187cc-630f-488c-93ff-6251dc5df31c', '62cda521-1558-41ae-8ce1-c3eef1bad158'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:24 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:24 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:24 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:25 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9.ad1d345c-09fa-4358-8fc4-4a4b3593187d" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-09795c18-7b29-4bee-99a3-162449b12a02-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ad1d345c-09fa-4358-8fc4-4a4b3593187d" released by "_delete_snapshot" :: held 1.688s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-09795c18-7b29-4bee-99a3-162449b12a02-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" released by "delete_snapshot" :: held 1.728s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:25 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.291s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Deleted volume successfully. Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ef11d-0d69-4520-a5b4-a019cbca5763]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9209296c-698a-4147-9ca0-e661a8007af8 tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-8fd91788-164b-4b05-b711-09df9718ea4f-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Created reservations ['a821c387-0d07-4bbe-ad38-44749341d704', 'ab46160b-fc9d-4d4c-b79e-ff7f9261c2fb', '6521a1b4-84a9-4551-89ae-021c29f07e7d', 'b5e1260a-e074-4afd-aab6-94a599b26730'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:25 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1fa5878d-1c47-45b0-bf6d-c04ce71b636d tempest-ProjectMemberTests-80746963 None] Lock "cinder-ad1d345c-09fa-4358-8fc4-4a4b3593187d-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:25 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 Sep 22 18:40:25 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-dae17776-e846-4906-ad8f-75b3c993c4f9-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "cinder-dae17776-e846-4906-ad8f-75b3c993c4f9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:25 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02" returned: 0 in 0.401s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:25 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02 Sep 22 18:40:25 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa26fc-b03d-4516-8712-bfb13d8a3a79]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:25 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 Sep 22 18:40:25 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:25 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-09795c18-7b29-4bee-99a3-162449b12a02" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:25 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-quobyte-09795c18-7b29-4bee-99a3-162449b12a02" released by "delete_volume" :: held 0.721s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Created reservations ['9bcca753-bc64-4f8a-a143-1b68573c50d6', 'ed6d032c-5966-409a-88a9-e5b10f64a558', '343b6058-c9c1-4793-bc0e-abbcb241cc04', '46432fbc-0a3c-40a2-9227-58e4d9d345c7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:26 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:26 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:26 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:26 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9 Sep 22 18:40:26 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:26 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Deleted volume successfully. Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1cbec7b8-d3d6-4c4b-ac53-0fe5de34ba9c tempest-SnapshotDependencyTests-589468051 None] Lock "cinder-09795c18-7b29-4bee-99a3-162449b12a02-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:26 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-dae17776-e846-4906-ad8f-75b3c993c4f9" returned: 0 in 0.321s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-dae17776-e846-4906-ad8f-75b3c993c4f9" released by "delete_volume" :: held 0.846s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Created reservations ['0f8bebd4-349f-4485-866a-a13c9177c90b', 'dd6ff696-8328-405f-81d8-5df866266f4b', '830f9fd3-cb62-428d-aa66-fc3464ac031c', '8d9f2a6d-6661-42cf-954c-5e05b030aa1b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:26 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:26 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:26 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.282s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:40:26 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1162cf5d-1914-4d1c-adc2-dc6e6fd810f0 tempest-ProjectMemberTests-80746963 None] Lock "cinder-dae17776-e846-4906-ad8f-75b3c993c4f9-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (167db3e5-fb4d-4fcd-b7a7-7e8bfa079c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f98ec-01b4-4337-bc86-9bf067c4fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f98ec-01b4-4337-bc86-9bf067c4fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2107033264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c117a99b-3614-421c-86ff-07772d946faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:27Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3578e1b2-f4f1-4de9-bd17-43b498f66cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3578e1b2-f4f1-4de9-bd17-43b498f66cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766066a-bdf2-4cfc-aaad-f8b67ce2c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766066a-bdf2-4cfc-aaad-f8b67ce2c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c117a99b-3614-421c-86ff-07772d946faf', 'volume_name': 'volume-c117a99b-3614-421c-86ff-07772d946faf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e65be-5adc-4d51-bfc8-96c43edbe186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e65be-5adc-4d51-bfc8-96c43edbe186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d24e8e8-2f54-4d57-8106-fa2ecfa39bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:27 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Volume c117a99b-3614-421c-86ff-07772d946faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c117a99b-3614-421c-86ff-07772d946faf', 'volume_size': 1} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2107033264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c117a99b-3614-421c-86ff-07772d946faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:27Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Creating volume c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:27 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:27 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf 1073741824 Sep 22 18:40:27 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:27 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf 1073741824" returned: 0 in 0.498s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:28 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf Sep 22 18:40:28 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:28 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf" returned: 0 in 0.302s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d24e8e8-2f54-4d57-8106-fa2ecfa39bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c117a99b-3614-421c-86ff-07772d946faf', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b7ed0d-0fbd-47c4-a9d6-a41cbc3212b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:28 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Volume volume-c117a99b-3614-421c-86ff-07772d946faf (c117a99b-3614-421c-86ff-07772d946faf): created successfully Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b7ed0d-0fbd-47c4-a9d6-a41cbc3212b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:28 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (167db3e5-fb4d-4fcd-b7a7-7e8bfa079c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:28 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3f59d835-40e2-44b4-acea-d14b6a2be7c5 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot 3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 of volume c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda96536-b318-4eba-a775-78ce4f7e2851]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:29 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf Sep 22 18:40:29 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:29 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:30 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 1G Sep 22 18:40:30 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:30 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 1G" returned: 0 in 0.583s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c117a99b-3614-421c-86ff-07772d946faf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:30 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c117a99b-3614-421c-86ff-07772d946faf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 Sep 22 18:40:30 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:30 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c117a99b-3614-421c-86ff-07772d946faf -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" returned: 0 in 0.322s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:30 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 is being set with open permissions: ugo+rw Sep 22 18:40:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:30 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 Sep 22 18:40:30 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:31 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" returned: 0 in 0.290s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:31 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info Sep 22 18:40:31 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:31 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info" returned: 0 in 0.289s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:31 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info is being set with open permissions: ugo+rw Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:31 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info Sep 22 18:40:31 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:31 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.info" returned: 0 in 0.262s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f509508e-1de8-43b0-9ebd-e0d810ff40a0 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot 3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 of volume c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d4f5f5-8c45-4167-b52e-897faf96a4b1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:33 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 Sep 22 18:40:33 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:33 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" returned: 0 in 0.395s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c117a99b-3614-421c-86ff-07772d946faf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7a9a2-574c-44e9-94a8-9f0e59072afb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:33 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf Sep 22 18:40:33 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:33 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf" returned: 0 in 0.419s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:33 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 Sep 22 18:40:33 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:34 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" returned: 0 in 0.467s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:34 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8 Sep 22 18:40:34 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:34 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf.3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8" released by "_delete_snapshot" :: held 1.674s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" released by "delete_snapshot" :: held 1.707s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Created reservations ['8963fea2-bd12-43f3-bf0c-d8e7111ad136', 'f313b393-ca77-40c7-b656-b57e87d5931d', 'f1e301ae-2b3e-4c69-9393-fbb3fa9c1c68', 'ef53141f-4c76-4b23-a927-8466c27bfa10'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-6c91b49d-2024-4277-9ab3-31338bfb5ee7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-3c00f1fa-d2ad-4b98-bcf0-e58d08dbe3e8-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:34 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-c117a99b-3614-421c-86ff-07772d946faf-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "cinder-c117a99b-3614-421c-86ff-07772d946faf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" acquired by "delete_volume" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3802283-754b-4dbd-b78c-1aa46113fc78]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:35 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf Sep 22 18:40:35 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:35 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf" returned: 0 in 0.431s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:35 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf Sep 22 18:40:35 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:35 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-c117a99b-3614-421c-86ff-07772d946faf" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-c117a99b-3614-421c-86ff-07772d946faf" released by "delete_volume" :: held 0.830s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Created reservations ['837bd6cf-6123-45cd-b86a-9a57fddb8d1f', 'd5156fb7-db28-410e-8b6d-0dbb52b42d75', '73b96224-44b1-4020-ae7b-07404665d28a', '9727eaf1-18c2-413b-b754-07e909b75b9a'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:36 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:36 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:36 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.298s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-aaade801-1b67-4253-ac6f-12030726fb50 tempest-ProjectMemberTests-80746963 None] Lock "cinder-c117a99b-3614-421c-86ff-07772d946faf-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (5a79fee5-cdb6-4c66-8aca-b1797992e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f5488-a738-4d1b-b0c4-23ce857532b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f5488-a738-4d1b-b0c4-23ce857532b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591790383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252b0f09-5993-4603-a670-ba70e1d9e72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:37Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8381d46-2dd5-430d-a8fc-ecb81ff725e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8381d46-2dd5-430d-a8fc-ecb81ff725e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2a3e5-1ceb-4efc-b991-45f94b924415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2a3e5-1ceb-4efc-b991-45f94b924415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252b0f09-5993-4603-a670-ba70e1d9e72f', 'volume_name': 'volume-252b0f09-5993-4603-a670-ba70e1d9e72f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9125ab0-7406-4ec7-bbed-7b9a12d0913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:36 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9125ab0-7406-4ec7-bbed-7b9a12d0913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21833cd3-7c6f-4e7f-a194-979d35fec1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:37 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Volume 252b0f09-5993-4603-a670-ba70e1d9e72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252b0f09-5993-4603-a670-ba70e1d9e72f', 'volume_size': 1} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591790383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252b0f09-5993-4603-a670-ba70e1d9e72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:37Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Creating volume 252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:37 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:37 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f 1073741824 Sep 22 18:40:37 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:37 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f 1073741824" returned: 0 in 0.581s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:37 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f Sep 22 18:40:37 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:37 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21833cd3-7c6f-4e7f-a194-979d35fec1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252b0f09-5993-4603-a670-ba70e1d9e72f', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2532e14e-f62c-4ae5-b666-6b691e1af6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:37 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Volume volume-252b0f09-5993-4603-a670-ba70e1d9e72f (252b0f09-5993-4603-a670-ba70e1d9e72f): created successfully Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2532e14e-f62c-4ae5-b666-6b691e1af6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:37 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (5a79fee5-cdb6-4c66-8aca-b1797992e70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:37 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-97c2515f-7357-4c63-adfe-8751f1bfeff4 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Flow 'volume_create_manager' (cc5fd316-6209-46d5-88b7-3d06eb0b5326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddbaeb0-005b-4ff9-9e1f-782843f09b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddbaeb0-005b-4ff9-9e1f-782843f09b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273537578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51671d62-0e74-4ff9-a1b0-a7d04a247211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a036197d8d4548c1a5a7ba29cfda83e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:39Z,use_quota=True,user_id='b89a96833afa443e9e3a68c73543e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c630375e-96cc-4b51-98f5-14037ad7563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c630375e-96cc-4b51-98f5-14037ad7563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9d3eb1-ccf4-4b5c-923e-69614e3558a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9d3eb1-ccf4-4b5c-923e-69614e3558a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51671d62-0e74-4ff9-a1b0-a7d04a247211', 'volume_name': 'volume-51671d62-0e74-4ff9-a1b0-a7d04a247211', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8922883-6a8c-4666-b4e0-97bcf08cbe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8922883-6a8c-4666-b4e0-97bcf08cbe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca182c5-1aea-49ca-bfbc-e0a95a6164e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Volume 51671d62-0e74-4ff9-a1b0-a7d04a247211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51671d62-0e74-4ff9-a1b0-a7d04a247211', 'volume_size': 1} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273537578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51671d62-0e74-4ff9-a1b0-a7d04a247211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a036197d8d4548c1a5a7ba29cfda83e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:39Z,use_quota=True,user_id='b89a96833afa443e9e3a68c73543e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Creating volume 51671d62-0e74-4ff9-a1b0-a7d04a247211 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:39 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:39 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 1073741824 Sep 22 18:40:39 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:39 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 1073741824" returned: 0 in 0.402s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:39 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 Sep 22 18:40:39 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:39 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca182c5-1aea-49ca-bfbc-e0a95a6164e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51671d62-0e74-4ff9-a1b0-a7d04a247211', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9770a401-33ad-48a9-badc-611b2e5bf632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot 2b309736-989e-4195-82cd-19fdc1efdfc0 of volume 252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:39 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Volume volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 (51671d62-0e74-4ff9-a1b0-a7d04a247211): created successfully Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9770a401-33ad-48a9-badc-611b2e5bf632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Flow 'volume_create_manager' (cc5fd316-6209-46d5-88b7-3d06eb0b5326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba59d5d-7ad5-44db-acd4-e68ad3071dfb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2e77629e-a429-4d05-b64f-0cb32955110a tempest-ProjectReaderTests-1823867574 None] Created volume successfully. Sep 22 18:40:40 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f Sep 22 18:40:40 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Acquiring lock "cinder-51671d62-0e74-4ff9-a1b0-a7d04a247211-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "cinder-51671d62-0e74-4ff9-a1b0-a7d04a247211-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:40 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Acquiring lock "cinder-quobyte-51671d62-0e74-4ff9-a1b0-a7d04a247211" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f" returned: 0 in 0.422s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "cinder-quobyte-51671d62-0e74-4ff9-a1b0-a7d04a247211" acquired by "delete_volume" :: waited 0.029s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:40 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 1G Sep 22 18:40:40 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8491de-42ab-4aab-b9ee-1150bf657ed9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:40 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 Sep 22 18:40:40 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:40 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 1G" returned: 0 in 0.443s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252b0f09-5993-4603-a670-ba70e1d9e72f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:40 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252b0f09-5993-4603-a670-ba70e1d9e72f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 Sep 22 18:40:40 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:40 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211" returned: 0 in 0.444s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:40 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211 Sep 22 18:40:40 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:41 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252b0f09-5993-4603-a670-ba70e1d9e72f -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0" returned: 0 in 0.311s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 is being set with open permissions: ugo+rw Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:41 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-51671d62-0e74-4ff9-a1b0-a7d04a247211" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 Sep 22 18:40:41 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "cinder-quobyte-51671d62-0e74-4ff9-a1b0-a7d04a247211" released by "delete_volume" :: held 0.769s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Created reservations ['2fa40cc5-231f-4b96-a404-86016b9d1458', '20715b3d-d5ea-4ae1-b38a-a09ca350160d', 'a62c9864-56fc-4fb4-904a-6ef95c23530b', '7954fda5-ea4e-40df-ae74-bfbce31bec90'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:41 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:41 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:41 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:41 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info Sep 22 18:40:41 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:41 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Deleted volume successfully. Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-625ec00c-79b7-4f75-95b7-f709ba7aa28f tempest-ProjectReaderTests-1823867574 None] Lock "cinder-51671d62-0e74-4ff9-a1b0-a7d04a247211-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:41 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info" returned: 0 in 0.271s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info is being set with open permissions: ugo+rw Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:41 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info Sep 22 18:40:41 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:41 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.info" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:41 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Flow 'volume_create_manager' (83f8b36f-c0a0-465c-b9fc-42e37bbb8365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b863bfd6-2388-4865-bfc0-22b3c2ba8d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b863bfd6-2388-4865-bfc0-22b3c2ba8d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373939782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d59838f-9ba3-44a4-9a35-ad7d0b1910ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a036197d8d4548c1a5a7ba29cfda83e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:42Z,use_quota=True,user_id='b89a96833afa443e9e3a68c73543e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b7c4b-98b4-4179-b77d-be34d7f0c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198b7c4b-98b4-4179-b77d-be34d7f0c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc15b344-a64b-463d-aa6f-9ae5af26c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc15b344-a64b-463d-aa6f-9ae5af26c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d59838f-9ba3-44a4-9a35-ad7d0b1910ff', 'volume_name': 'volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb5d68f-bdb9-4362-ac9d-fafe234dbb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb5d68f-bdb9-4362-ac9d-fafe234dbb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a89b2a0-4a6c-4606-8d3a-7cf7fd05f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Volume 4d59838f-9ba3-44a4-9a35-ad7d0b1910ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff', 'volume_size': 1} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373939782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d59838f-9ba3-44a4-9a35-ad7d0b1910ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a036197d8d4548c1a5a7ba29cfda83e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:42Z,use_quota=True,user_id='b89a96833afa443e9e3a68c73543e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Creating volume 4d59838f-9ba3-44a4-9a35-ad7d0b1910ff {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:42 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:42 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff 1073741824 Sep 22 18:40:42 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d054e044-0273-4034-9c57-4bc614dd5fd7 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-2b309736-989e-4195-82cd-19fdc1efdfc0-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-2b309736-989e-4195-82cd-19fdc1efdfc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-2b309736-989e-4195-82cd-19fdc1efdfc0" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-2b309736-989e-4195-82cd-19fdc1efdfc0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot 2b309736-989e-4195-82cd-19fdc1efdfc0 of volume 252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49d29a-9a33-4895-ba7b-caa5b4edc868]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:42 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 Sep 22 18:40:42 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:42 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff 1073741824" returned: 0 in 0.462s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:42 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff Sep 22 18:40:42 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:42 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0" returned: 0 in 0.383s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252b0f09-5993-4603-a670-ba70e1d9e72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[88593996-49d6-4e1c-9eed-ea5becf7afb8]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:42 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a89b2a0-4a6c-4606-8d3a-7cf7fd05f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee2f600-f9ce-43f0-aaa5-65390395dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:42 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Volume volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff (4d59838f-9ba3-44a4-9a35-ad7d0b1910ff): created successfully Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee2f600-f9ce-43f0-aaa5-65390395dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:42 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Flow 'volume_create_manager' (83f8b36f-c0a0-465c-b9fc-42e37bbb8365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:42 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c71807c4-e58f-40e0-bf87-e5b98e648e2e tempest-ProjectReaderTests-1823867574 None] Created volume successfully. Sep 22 18:40:42 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f Sep 22 18:40:42 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:43 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f" returned: 0 in 0.373s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:43 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 Sep 22 18:40:43 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:43 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0" returned: 0 in 0.315s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:43 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0 Sep 22 18:40:43 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:43 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f.2b309736-989e-4195-82cd-19fdc1efdfc0" returned: 0 in 0.230s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-2b309736-989e-4195-82cd-19fdc1efdfc0" released by "_delete_snapshot" :: held 1.395s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" released by "delete_snapshot" :: held 1.417s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Created reservations ['2028a930-647c-4361-b59f-856c35e8fe72', '3978bcac-171d-4d8d-9250-306e5ef3e8a0', 'bd1106de-05b9-4957-a4fc-d09a38fc80e4', 'a7cf7573-a86f-428d-ac53-51803b849e0b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d42552a6-6982-4962-ad7f-958117b7a3a3 tempest-ProjectMemberTests-80746963 None] Lock "cinder-2b309736-989e-4195-82cd-19fdc1efdfc0-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Acquiring lock "cinder-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "cinder-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Acquiring lock "cinder-quobyte-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "cinder-quobyte-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0482df-b78f-4d56-8397-099ffabffe29]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:44 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff Sep 22 18:40:44 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-252b0f09-5993-4603-a670-ba70e1d9e72f-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "cinder-252b0f09-5993-4603-a670-ba70e1d9e72f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:44 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" returned: 0 in 0.407s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[609cec73-781a-4614-b48c-06658f7bf3fc]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:44 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff Sep 22 18:40:44 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:44 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f Sep 22 18:40:44 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:44 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "cinder-quobyte-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff" released by "delete_volume" :: held 0.701s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Created reservations ['c0b765c5-afb1-4498-b591-c63f8c5046ff', '09410052-c878-4c4f-8715-31d9219b1d8b', 'b0b596af-5cb9-4ef0-ad31-767994c4b16b', '47352129-331f-4ebe-ba58-48edea2c26e7'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:44 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:44 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:44 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:45 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f Sep 22 18:40:45 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:45 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.267s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Deleted volume successfully. Sep 22 18:40:45 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-252b0f09-5993-4603-a670-ba70e1d9e72f" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-252b0f09-5993-4603-a670-ba70e1d9e72f" released by "delete_volume" :: held 0.709s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f66192d3-4bda-4ec8-8ef0-62823842c421 tempest-ProjectReaderTests-1823867574 None] Lock "cinder-4d59838f-9ba3-44a4-9a35-ad7d0b1910ff-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Created reservations ['b8a46d0c-a3d6-4f6b-81c4-8b7cec71d946', 'bd36c446-4a0b-4eaa-985f-7900b1fc5662', 'd8a545d4-56b8-4409-985a-571a9a6d184d', 'bc8c3cff-f567-43d3-9307-7cae95020b2b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:45 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:45 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:45 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.274s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:40:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-15aac6b3-db3a-4986-9c9b-39cd78fb6c69 tempest-ProjectMemberTests-80746963 None] Lock "cinder-252b0f09-5993-4603-a670-ba70e1d9e72f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (7db40d2c-1596-4b13-afb7-41d9cfe58235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd62ee6-834c-49e1-bfbe-f62d33605ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd62ee6-834c-49e1-bfbe-f62d33605ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830655981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11aee2b-7c7e-40e0-8b0a-b8abfd49310a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:46Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9eda50-97cb-48c4-beb4-ed265522c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9eda50-97cb-48c4-beb4-ed265522c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0816770c-9fdf-4e78-8644-05a310f82615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0816770c-9fdf-4e78-8644-05a310f82615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11aee2b-7c7e-40e0-8b0a-b8abfd49310a', 'volume_name': 'volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dce2d5-6370-48f0-829a-d824e5241dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dce2d5-6370-48f0-829a-d824e5241dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e00dd-a234-445c-96f2-d572af902514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:46 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Volume a11aee2b-7c7e-40e0-8b0a-b8abfd49310a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a', 'volume_size': 1} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830655981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11aee2b-7c7e-40e0-8b0a-b8abfd49310a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:46Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Creating volume a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:46 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:46 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a 1073741824 Sep 22 18:40:46 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:46 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a 1073741824" returned: 0 in 0.472s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:46 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a Sep 22 18:40:46 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:47 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e00dd-a234-445c-96f2-d572af902514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191122e9-7698-4e33-b388-74c14e15e983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Volume volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a (a11aee2b-7c7e-40e0-8b0a-b8abfd49310a): created successfully Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191122e9-7698-4e33-b388-74c14e15e983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (7db40d2c-1596-4b13-afb7-41d9cfe58235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:47 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-065038e1-6cfc-4f70-a3fd-02179078df29 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Creating offline snapshot ec14cafc-c87f-46b6-8298-1f683ecba00f of volume a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150123d-7f7b-4ef6-bbfd-c897fd16ddef]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:48 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a Sep 22 18:40:48 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:48 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:48 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:48 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" returned: 0 in 0.363s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:48 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f 1G Sep 22 18:40:48 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:48 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.277s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:40:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:40:49 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f 1G" returned: 0 in 0.409s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:49 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f Sep 22 18:40:49 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:49 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f" returned: 0 in 0.283s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:49 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f is being set with open permissions: ugo+rw Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:49 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f Sep 22 18:40:49 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:49 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:49 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info Sep 22 18:40:49 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:49 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:49 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info is being set with open permissions: ugo+rw Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:50 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info Sep 22 18:40:50 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:50 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.info" returned: 0 in 0.234s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-3f44d46f-2fdf-42e8-ba6b-b37a277a197a tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-ec14cafc-c87f-46b6-8298-1f683ecba00f-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-ec14cafc-c87f-46b6-8298-1f683ecba00f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-ec14cafc-c87f-46b6-8298-1f683ecba00f" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ec14cafc-c87f-46b6-8298-1f683ecba00f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot ec14cafc-c87f-46b6-8298-1f683ecba00f of volume a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8f3434-2c0f-48ac-abc6-d8b7b5a92ee5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:50 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f Sep 22 18:40:50 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:50 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f" returned: 0 in 0.356s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96d3d5-5d65-4a31-b139-818ea21c6191]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:51 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a Sep 22 18:40:51 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:51 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" returned: 0 in 0.357s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:51 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f Sep 22 18:40:51 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:51 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:51 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f Sep 22 18:40:51 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:51 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a.ec14cafc-c87f-46b6-8298-1f683ecba00f" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ec14cafc-c87f-46b6-8298-1f683ecba00f" released by "_delete_snapshot" :: held 1.389s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" released by "delete_snapshot" :: held 1.410s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=114,cinder:INSERT=39,cinder:UPDATE=145,cinder:DELETE=15 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:40:51 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=122,cinder:INSERT=40,cinder:UPDATE=154,cinder:DELETE=10 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Created reservations ['49428a38-f80e-48ec-a224-2330150cc90b', '6319cdd6-ec5d-446e-bcd0-896c6835b0ca', '5476a7e3-d398-4a91-b99e-37fcc86f3866', '1eb71c3b-c8b5-434c-a225-e7eb45131b7b'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-77dc087e-139b-48bf-b52e-404c21bffae7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-ec14cafc-c87f-46b6-8298-1f683ecba00f-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "cinder-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[90803197-2cec-4f75-93fc-7cdae48c33c1]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:52 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a Sep 22 18:40:52 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:53 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:53 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a Sep 22 18:40:53 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:53 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a" released by "delete_volume" :: held 0.675s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Created reservations ['b2e33ac6-a249-40f3-b960-fe71c5fa662c', 'f8e94f2c-25aa-4a91-9d8e-be70179e89f6', 'b19dfae5-e16e-40ce-ba06-30f59c7a2f73', '9b20c2ea-8ce8-48ff-9928-ca349c0b72eb'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:53 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:40:53 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:53 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:40:53 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:40:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-a2c472f1-512a-458d-b7f1-4208337d34df tempest-ProjectMemberTests-80746963 None] Lock "cinder-a11aee2b-7c7e-40e0-8b0a-b8abfd49310a-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (4fb2571e-a25e-4020-a960-cffedc4a7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36728854-61c4-40d1-b692-b77530afa15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36728854-61c4-40d1-b692-b77530afa15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387840146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:54Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4686ba-3881-4e40-913a-d626b8c67a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4686ba-3881-4e40-913a-d626b8c67a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3e886f-2e54-4786-b65a-2e0d49622f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3e886f-2e54-4786-b65a-2e0d49622f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c', 'volume_name': 'volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21b37c4-94af-4d4c-a324-ce8d0872e9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21b37c4-94af-4d4c-a324-ce8d0872e9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac060d2-62b3-4287-b115-09a9506943b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Volume cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c', 'volume_size': 1} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387840146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:40:54Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Creating volume cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:40:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:54 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c 1073741824 Sep 22 18:40:54 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:54 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c 1073741824" returned: 0 in 0.421s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:54 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c Sep 22 18:40:54 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:55 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac060d2-62b3-4287-b115-09a9506943b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e2fecb-ca1e-4e89-9bec-2e324eb72f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:40:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Volume volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c (cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c): created successfully Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e2fecb-ca1e-4e89-9bec-2e324eb72f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (4fb2571e-a25e-4020-a960-cffedc4a7f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:40:55 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aabb4edd-cd4a-4fb7-99ae-64a457668bfd tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot b70ad28b-9f9f-40bc-89a9-a324c0e31411 of volume cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0660eb-bf87-48c6-b32c-4b49ffce5ecc]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:55 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c Sep 22 18:40:55 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:55 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" returned: 0 in 0.363s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:55 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 1G Sep 22 18:40:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:56 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 1G" returned: 0 in 0.388s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:56 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 Sep 22 18:40:56 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:56 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411" returned: 0 in 0.285s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:56 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 is being set with open permissions: ugo+rw Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:56 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 Sep 22 18:40:56 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:56 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:56 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info Sep 22 18:40:56 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:57 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info" returned: 0 in 0.246s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:57 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info is being set with open permissions: ugo+rw Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:57 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info Sep 22 18:40:57 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:57 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.info" returned: 0 in 0.255s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:40:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a7b1b627-a4c0-4459-8da6-8f7190fc2018 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-b70ad28b-9f9f-40bc-89a9-a324c0e31411-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-b70ad28b-9f9f-40bc-89a9-a324c0e31411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-b70ad28b-9f9f-40bc-89a9-a324c0e31411" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-b70ad28b-9f9f-40bc-89a9-a324c0e31411" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot b70ad28b-9f9f-40bc-89a9-a324c0e31411 of volume cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac5cfb-3188-41ad-9d77-d553f019a443]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:57 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 Sep 22 18:40:57 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:58 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411" returned: 0 in 0.372s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46612fd-3f89-43a4-b8cb-08297cde060e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:58 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c Sep 22 18:40:58 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:58 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:58 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 Sep 22 18:40:58 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:58 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411" returned: 0 in 0.350s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:40:58 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411 Sep 22 18:40:58 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:40:59 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c.b70ad28b-9f9f-40bc-89a9-a324c0e31411" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-b70ad28b-9f9f-40bc-89a9-a324c0e31411" released by "_delete_snapshot" :: held 1.441s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" released by "delete_snapshot" :: held 1.463s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Created reservations ['439c0aed-4d2b-4dc3-a705-ad53d541ab2a', '70b82882-ef8c-409d-ac0f-425912c5a849', '589f82ce-ecb8-4da2-bd0f-f77bd3c1fad2', '8d40eee1-7afc-4b57-8259-7f5373cf9366'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:40:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-fd30b90c-87e9-4f9c-b18b-8df4a31fb7b1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-b70ad28b-9f9f-40bc-89a9-a324c0e31411-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "cinder-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" acquired by "delete_volume" :: waited 0.021s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0d9695-017e-41f7-bea4-309ffcf7e54a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:40:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:00 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c Sep 22 18:41:00 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:00 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" returned: 0 in 0.380s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:00 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c Sep 22 18:41:00 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:00 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c" released by "delete_volume" :: held 0.683s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Created reservations ['810a2c7d-f6f2-40de-b288-41eb047a1b70', '96251d22-aeb1-4311-8071-df7fe4cf947b', '5876b0ac-51b8-46c7-b8b2-a58f1f5d79a5', '3bef4d0d-fa90-4995-86a1-60ff0838f40f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:00 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:00 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:00 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:00 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:41:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-baea1cc4-5808-48e0-95b3-9d69ebaa5c7d tempest-ProjectMemberTests-80746963 None] Lock "cinder-cfa9d0ca-2c8d-4511-bc48-7d81335d6b2c-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (99f52583-be20-4efa-9808-1e24aadbb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b501a1e-fc89-48d7-935d-d7692f67f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b501a1e-fc89-48d7-935d-d7692f67f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633507928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca74d3c-0033-4750-9d3a-c60d222acd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:01Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2778ece-c86d-45fa-a1ab-a13db9cd8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2778ece-c86d-45fa-a1ab-a13db9cd8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2dd4ba-af6f-47ba-97ca-4b990e9759e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2dd4ba-af6f-47ba-97ca-4b990e9759e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca74d3c-0033-4750-9d3a-c60d222acd0d', 'volume_name': 'volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab9dfa-bd98-4290-a82e-6a9c77d17e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab9dfa-bd98-4290-a82e-6a9c77d17e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924bc1be-1b2b-4521-bc21-fa179e840a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:01 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Volume 0ca74d3c-0033-4750-9d3a-c60d222acd0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d', 'volume_size': 1} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633507928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca74d3c-0033-4750-9d3a-c60d222acd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:01Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Creating volume 0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:01 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:01 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d 1073741824 Sep 22 18:41:01 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:01 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d 1073741824" returned: 0 in 0.423s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:02 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d Sep 22 18:41:02 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:02 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d" returned: 0 in 0.268s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924bc1be-1b2b-4521-bc21-fa179e840a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f41f6bc-4056-4723-bd42-03ee60d91a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:02 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Volume volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d (0ca74d3c-0033-4750-9d3a-c60d222acd0d): created successfully Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f41f6bc-4056-4723-bd42-03ee60d91a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (99f52583-be20-4efa-9808-1e24aadbb516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:02 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f232686e-7c4d-428a-b349-ca9bc0e53e45 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot b835ce49-8c19-4151-a7b0-85d09369be76 of volume 0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409e9de-230e-42bc-bf37-44ee7a02c481]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:02 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:02 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d Sep 22 18:41:02 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:03 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d" returned: 0 in 0.361s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:03 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 1G Sep 22 18:41:03 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:03 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 1G" returned: 0 in 0.389s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:03 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 Sep 22 18:41:03 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:03 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76" returned: 0 in 0.296s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:03 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 is being set with open permissions: ugo+rw Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:03 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 Sep 22 18:41:03 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:03 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:03 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:04 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info Sep 22 18:41:04 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:04 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info" returned: 0 in 0.259s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:04 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info is being set with open permissions: ugo+rw Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:04 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info Sep 22 18:41:04 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:04 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.info" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:04 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-aa797e03-f7c8-4700-a6a4-7f4dd52f8fa3 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-b835ce49-8c19-4151-a7b0-85d09369be76-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-b835ce49-8c19-4151-a7b0-85d09369be76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-b835ce49-8c19-4151-a7b0-85d09369be76" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-b835ce49-8c19-4151-a7b0-85d09369be76" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot b835ce49-8c19-4151-a7b0-85d09369be76 of volume 0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8975862b-8284-4319-adc5-a5b131f2cb30]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:05 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 Sep 22 18:41:05 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:05 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76" returned: 0 in 0.417s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6b953-87b4-4866-9bb1-10ed3644f36b]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:05 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d Sep 22 18:41:05 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:05 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d" returned: 0 in 0.385s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:05 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 Sep 22 18:41:05 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:06 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76" returned: 0 in 0.334s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:06 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76 Sep 22 18:41:06 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:06 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d.b835ce49-8c19-4151-a7b0-85d09369be76" returned: 0 in 0.240s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-b835ce49-8c19-4151-a7b0-85d09369be76" released by "_delete_snapshot" :: held 1.474s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" released by "delete_snapshot" :: held 1.497s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Created reservations ['495717f6-22b1-4358-9727-a26285c34038', 'a543f5b1-dcdc-4f47-be57-5a10a2c0eb53', '47e69623-1d0b-42b8-a87e-bd4121e032bf', '6bc61c4e-dffc-40ed-a2ac-4fd49fdfd479'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:06 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-7760eaf7-b0f0-43ba-831a-d72ee68f993b tempest-ProjectMemberTests-80746963 None] Lock "cinder-b835ce49-8c19-4151-a7b0-85d09369be76-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-0ca74d3c-0033-4750-9d3a-c60d222acd0d-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "cinder-0ca74d3c-0033-4750-9d3a-c60d222acd0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[682fa2a2-0472-49c9-b8dc-ffd024897b12]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:07 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d Sep 22 18:41:07 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:07 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d" returned: 0 in 0.347s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:07 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d Sep 22 18:41:07 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:07 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-0ca74d3c-0033-4750-9d3a-c60d222acd0d" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-0ca74d3c-0033-4750-9d3a-c60d222acd0d" released by "delete_volume" :: held 0.672s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Created reservations ['1b46e9ad-608d-4257-afd1-d2d481bb47a6', 'fee7f43b-cf9b-45d1-8ac5-66d6980333b1', '8339d754-e499-43a6-9b1c-1691604f823d', '7e584763-8879-4fa6-a86a-fe5d6789c1ed'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:07 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:07 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:08 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.266s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-19c74d8d-471f-48e1-905c-2018c09db8ae tempest-ProjectMemberTests-80746963 None] Lock "cinder-0ca74d3c-0033-4750-9d3a-c60d222acd0d-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (cd35c01e-dca9-45e9-9aa0-6300bad891fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393bf0e-697a-47e0-b9db-615e42a07a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393bf0e-697a-47e0-b9db-615e42a07a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144011933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:09Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d71d04d-55c9-43c5-a2d9-91fde5f94e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d71d04d-55c9-43c5-a2d9-91fde5f94e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1fe8f8-64a9-48c3-b06e-73442ea8c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1fe8f8-64a9-48c3-b06e-73442ea8c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb', 'volume_name': 'volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff29b4-38fe-458d-a71a-da35557b9a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ff29b4-38fe-458d-a71a-da35557b9a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b74b7a-9e2c-4b20-993a-d2e9202f8512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:08 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Volume e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb', 'volume_size': 1} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144011933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:09Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Creating volume e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:08 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:08 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb 1073741824 Sep 22 18:41:08 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:09 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb 1073741824" returned: 0 in 0.418s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:09 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb Sep 22 18:41:09 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:09 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" returned: 0 in 0.229s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b74b7a-9e2c-4b20-993a-d2e9202f8512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c58ea99-6450-49fc-a63d-d5757d2afce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:09 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Volume volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb (e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb): created successfully Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c58ea99-6450-49fc-a63d-d5757d2afce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (cd35c01e-dca9-45e9-9aa0-6300bad891fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d3fc5774-1740-4a2a-88b8-897a4b05ffe9 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Creating offline snapshot d6c3b94a-d70f-45fd-8acb-daf9c842a797 of volume e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca87a23-e1cc-4079-b73c-c755b784a32a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:09 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb Sep 22 18:41:09 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:10 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" returned: 0 in 0.370s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:10 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 1G Sep 22 18:41:10 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:10 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 1G" returned: 0 in 0.390s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:10 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 Sep 22 18:41:10 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:10 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797" returned: 0 in 0.293s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:10 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 is being set with open permissions: ugo+rw Sep 22 18:41:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:10 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 Sep 22 18:41:10 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:11 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:11 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info Sep 22 18:41:11 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:11 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info" returned: 0 in 0.276s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:11 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info is being set with open permissions: ugo+rw Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:11 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info Sep 22 18:41:11 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:11 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.info" returned: 0 in 0.244s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-919f10e9-b164-4504-bd2a-6ad15f7de3d7 tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-d6c3b94a-d70f-45fd-8acb-daf9c842a797-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-d6c3b94a-d70f-45fd-8acb-daf9c842a797-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-d6c3b94a-d70f-45fd-8acb-daf9c842a797" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-d6c3b94a-d70f-45fd-8acb-daf9c842a797" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot d6c3b94a-d70f-45fd-8acb-daf9c842a797 of volume e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:11 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e61493f-f282-4018-9a8d-65204bb9b632]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:12 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 Sep 22 18:41:12 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:12 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797" returned: 0 in 0.368s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dadb3c-a136-4716-afb2-d65a2b090f5c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:12 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb Sep 22 18:41:12 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:12 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:12 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 Sep 22 18:41:12 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:13 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797" returned: 0 in 0.326s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:13 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797 Sep 22 18:41:13 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:13 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb.d6c3b94a-d70f-45fd-8acb-daf9c842a797" returned: 0 in 0.233s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-d6c3b94a-d70f-45fd-8acb-daf9c842a797" released by "_delete_snapshot" :: held 1.393s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" released by "delete_snapshot" :: held 1.414s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Created reservations ['c1ff08d2-b6b4-41cc-91cc-435f8171fb97', 'bc49142e-0b98-4130-9936-c6e9d3e4ea21', '0eda592e-b008-4690-b986-5964d02e91a0', 'ca2ae7a6-61fc-4213-8b12-aed6548515d3'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:13 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:41:13 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-9917e1e4-f445-4f5f-83a6-84bbd49c3482 tempest-ProjectMemberTests-80746963 None] Lock "cinder-d6c3b94a-d70f-45fd-8acb-daf9c842a797-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "cinder-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1d9f8-06a0-4604-b70a-762f38bd1cad]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:14 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb Sep 22 18:41:14 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:14 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" returned: 0 in 0.349s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:14 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb Sep 22 18:41:14 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:14 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb" released by "delete_volume" :: held 0.656s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Created reservations ['dd70463d-43cb-4d3c-8328-d5204c97d4da', '7a0bb358-ff26-4192-8cab-5120528eb8ae', 'b5f49ec7-5a6a-4538-8f7e-16a358402674', 'e6004932-e349-4f70-a753-f5a6dac80ee0'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:14 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:14 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:14 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:15 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:15 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-138b3809-fae2-4565-bef0-27d892915360 tempest-ProjectMemberTests-80746963 None] Lock "cinder-e7930cd6-e5cf-4a6b-bdea-7a2aee2c7ebb-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (d2a22323-15f0-484c-a5cb-3ec926f26331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386dffd5-945f-4e25-9637-0f160626d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386dffd5-945f-4e25-9637-0f160626d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742179265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba92a015-7074-45bb-9604-47fd8e8a79f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:16Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f490ccc3-a91c-4ae0-96f6-1fc6fd0b80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f490ccc3-a91c-4ae0-96f6-1fc6fd0b80f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc01bab-2015-4772-af94-feefce7523a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc01bab-2015-4772-af94-feefce7523a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba92a015-7074-45bb-9604-47fd8e8a79f7', 'volume_name': 'volume-ba92a015-7074-45bb-9604-47fd8e8a79f7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b024be1-c298-4158-805a-0de31d3f3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b024be1-c298-4158-805a-0de31d3f3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59224a27-ceeb-4c5c-9973-3753396690ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:15 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Volume ba92a015-7074-45bb-9604-47fd8e8a79f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba92a015-7074-45bb-9604-47fd8e8a79f7', 'volume_size': 1} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742179265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba92a015-7074-45bb-9604-47fd8e8a79f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeef6b715424aa9b7a904e80463ddd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:16Z,use_quota=True,user_id='01314d60e10c4f93b110983446782f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Creating volume ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:15 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:15 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:15 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 1073741824 Sep 22 18:41:15 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:16 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 1073741824" returned: 0 in 0.409s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:16 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 Sep 22 18:41:16 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:16 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59224a27-ceeb-4c5c-9973-3753396690ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba92a015-7074-45bb-9604-47fd8e8a79f7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a719d1f3-ecd8-4030-990c-456dae55993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:16 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Volume volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 (ba92a015-7074-45bb-9604-47fd8e8a79f7): created successfully Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a719d1f3-ecd8-4030-990c-456dae55993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Flow 'volume_create_manager' (d2a22323-15f0-484c-a5cb-3ec926f26331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:16 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b37f2f08-6cc2-4b87-bea0-44b147474f27 tempest-ProjectMemberTests-80746963 None] Created volume successfully. Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Creating offline snapshot 30efacc5-0842-4195-9fbd-be93532a89e0 of volume ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f770637-e079-4c64-97a0-9bfc7504d4aa]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:16 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:16 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 Sep 22 18:41:16 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:17 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:17 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 1G Sep 22 18:41:17 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:17 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 1G" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:17 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 Sep 22 18:41:17 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:17 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0" returned: 0 in 0.303s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:17 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 is being set with open permissions: ugo+rw Sep 22 18:41:17 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:17 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 Sep 22 18:41:17 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:18 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0" returned: 0 in 0.264s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:18 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info Sep 22 18:41:18 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:18 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:18 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info is being set with open permissions: ugo+rw Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:18 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info Sep 22 18:41:18 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:18 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.info" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:18 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:18 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-6ea2d38c-930c-4b73-abcf-b0cbc800043d tempest-ProjectMemberTests-80746963 None] Create snapshot completed successfully Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-30efacc5-0842-4195-9fbd-be93532a89e0-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-30efacc5-0842-4195-9fbd-be93532a89e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-30efacc5-0842-4195-9fbd-be93532a89e0" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-30efacc5-0842-4195-9fbd-be93532a89e0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Deleting offline snapshot 30efacc5-0842-4195-9fbd-be93532a89e0 of volume ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] snapshot_file for this snap is: volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231318d-8b6e-438f-974a-3e75ecad5dbb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:19 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 Sep 22 18:41:19 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:19 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba92a015-7074-45bb-9604-47fd8e8a79f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f07ac-32b0-473d-9c79-31656afc3a37]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:19 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 Sep 22 18:41:19 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:19 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7" returned: 0 in 0.341s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:19 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 Sep 22 18:41:19 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:20 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0" returned: 0 in 0.336s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:20 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0 Sep 22 18:41:20 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:20 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7.30efacc5-0842-4195-9fbd-be93532a89e0" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-30efacc5-0842-4195-9fbd-be93532a89e0" released by "_delete_snapshot" :: held 1.397s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" released by "delete_snapshot" :: held 1.425s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Created reservations ['c42870d1-aab3-4a5a-a0c8-98b36689b9da', 'c39fae95-1585-4553-99bd-795e58a1738b', '3f5d699b-8374-41b6-bc5c-58a27af717b8', '0582444b-fe4c-45c9-afea-3b4b98b8695d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Delete snapshot completed successfully. Sep 22 18:41:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-36fb9262-0d49-43aa-903d-d9657973c7c1 tempest-ProjectMemberTests-80746963 None] Lock "cinder-30efacc5-0842-4195-9fbd-be93532a89e0-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-ba92a015-7074-45bb-9604-47fd8e8a79f7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-ba92a015-7074-45bb-9604-47fd8e8a79f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3e47e-c977-4137-9318-22076649e84a]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:21 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 Sep 22 18:41:21 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:21 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7" returned: 0 in 0.364s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:21 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7 Sep 22 18:41:21 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:21 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-ba92a015-7074-45bb-9604-47fd8e8a79f7" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:21 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-quobyte-ba92a015-7074-45bb-9604-47fd8e8a79f7" released by "delete_volume" :: held 0.674s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Created reservations ['9ee28ea2-f15e-46d8-bd38-82902535f1c3', '01ad0926-d348-4f18-87ca-5bd2ddc2937d', 'fcd6f7fe-aee6-48c9-8a92-ec88aaffab07', '80375dc4-3e74-4aad-9801-a5abc5b7481f'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:22 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:22 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:22 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:22 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Deleted volume successfully. Sep 22 18:41:22 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-ca61a716-c711-4976-a636-a9593a0fb1e7 tempest-ProjectMemberTests-80746963 None] Lock "cinder-ba92a015-7074-45bb-9604-47fd8e8a79f7-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:25 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (cb0e0abd-5b74-49f1-9446-8d8d72dc81d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:25 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1708ebf3-c52a-4fdd-a3af-2a4a4688b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1708ebf3-c52a-4fdd-a3af-2a4a4688b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50575445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb887d3-cd46-47c2-871c-568b546470d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:26Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f306805-2c7f-49df-b9de-0afe33b51565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f306805-2c7f-49df-b9de-0afe33b51565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea9f650-4d8f-4a6f-a7ab-a23266d46cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea9f650-4d8f-4a6f-a7ab-a23266d46cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb887d3-cd46-47c2-871c-568b546470d7', 'volume_name': 'volume-cfb887d3-cd46-47c2-871c-568b546470d7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d626559-7b3f-4716-86ca-42f17ec01e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d626559-7b3f-4716-86ca-42f17ec01e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d0dd8-dc28-4850-b0aa-e0d3515f656f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Volume cfb887d3-cd46-47c2-871c-568b546470d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb887d3-cd46-47c2-871c-568b546470d7', 'volume_size': 1} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50575445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb887d3-cd46-47c2-871c-568b546470d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:26Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Creating volume cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:26 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:26 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 1073741824 Sep 22 18:41:26 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:26 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 1073741824" returned: 0 in 0.396s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:26 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 Sep 22 18:41:26 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:26 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7" returned: 0 in 0.236s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d0dd8-dc28-4850-b0aa-e0d3515f656f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb887d3-cd46-47c2-871c-568b546470d7', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec07ff-51ef-44dc-89ef-5510fc06a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:26 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Volume volume-cfb887d3-cd46-47c2-871c-568b546470d7 (cfb887d3-cd46-47c2-871c-568b546470d7): created successfully Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec07ff-51ef-44dc-89ef-5510fc06a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (cb0e0abd-5b74-49f1-9446-8d8d72dc81d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7a624ddb-eade-4bb3-8087-9e7675dd4607 tempest-ProjectReaderTests-53104256 None] Created volume successfully. Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Creating offline snapshot 0b904213-4f36-4776-af77-dbcdb258a4c0 of volume cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a681444e-8ae2-4243-a3a5-4b3386208691]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:27 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 Sep 22 18:41:27 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:27 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7" returned: 0 in 0.362s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:27 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 1G Sep 22 18:41:27 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:27 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 1G" returned: 0 in 0.391s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:27 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb887d3-cd46-47c2-871c-568b546470d7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:27 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb887d3-cd46-47c2-871c-568b546470d7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 Sep 22 18:41:27 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:28 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb887d3-cd46-47c2-871c-568b546470d7 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0" returned: 0 in 0.289s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:28 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 is being set with open permissions: ugo+rw Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:28 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 Sep 22 18:41:28 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:28 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:28 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info Sep 22 18:41:28 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:28 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:28 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info is being set with open permissions: ugo+rw Sep 22 18:41:28 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:28 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info Sep 22 18:41:28 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:28 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.info" returned: 0 in 0.245s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:29 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-45b10a32-79ae-4d85-b5a5-380daccb476a tempest-ProjectReaderTests-53104256 None] Create snapshot completed successfully Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-0b904213-4f36-4776-af77-dbcdb258a4c0-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-0b904213-4f36-4776-af77-dbcdb258a4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-0b904213-4f36-4776-af77-dbcdb258a4c0" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-0b904213-4f36-4776-af77-dbcdb258a4c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Deleting offline snapshot 0b904213-4f36-4776-af77-dbcdb258a4c0 of volume cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] snapshot_file for this snap is: volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c806e-4720-496a-93de-e659e82838c9]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:29 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 Sep 22 18:41:29 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:29 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb887d3-cd46-47c2-871c-568b546470d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef2c8f-552a-4c4c-84fe-a07e6d548602]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:29 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:29 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 Sep 22 18:41:29 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:30 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:30 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 Sep 22 18:41:30 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:30 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0" returned: 0 in 0.329s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:30 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0 Sep 22 18:41:30 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:30 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7.0b904213-4f36-4776-af77-dbcdb258a4c0" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-0b904213-4f36-4776-af77-dbcdb258a4c0" released by "_delete_snapshot" :: held 1.416s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" released by "delete_snapshot" :: held 1.437s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:30 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Created reservations ['cb7abc1a-1651-49b5-98a8-dc9ed081d2bc', 'c08ec07d-2137-40eb-b80d-1d574f4352b4', '3eeccd6b-727c-4ec7-a8eb-7834673cfc6a', 'a3931944-987d-46b3-8adb-dc0eb313dcf2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:31 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Delete snapshot completed successfully. Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e213462f-b2c7-446b-b729-e9b6d6b99c35 tempest-ProjectReaderTests-53104256 None] Lock "cinder-0b904213-4f36-4776-af77-dbcdb258a4c0-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-cfb887d3-cd46-47c2-871c-568b546470d7-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "cinder-cfb887d3-cd46-47c2-871c-568b546470d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d9012-8a78-4360-ab9e-c815fbeae6c7]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:31 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:31 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 Sep 22 18:41:31 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:32 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7" returned: 0 in 0.360s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:32 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7 Sep 22 18:41:32 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:32 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-cfb887d3-cd46-47c2-871c-568b546470d7" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-cfb887d3-cd46-47c2-871c-568b546470d7" released by "delete_volume" :: held 0.666s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Created reservations ['85ab409d-21fd-42d0-a782-15cbadd6908c', '256f919e-8a14-4105-a820-33428e3d0005', '04afb3f0-c35e-410a-8820-0d7749f56a9a', 'f517dacd-04a7-49fb-a199-8df4f1138c88'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:32 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:32 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:32 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:32 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Deleted volume successfully. Sep 22 18:41:32 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-2c02b641-14f5-4a8f-8787-ae0a5eca7a4d tempest-ProjectReaderTests-53104256 None] Lock "cinder-cfb887d3-cd46-47c2-871c-568b546470d7-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (94e6c4c2-f2d5-4be2-b732-81daa00f2ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd362538-3cb1-4f84-b1b6-eb8d66c57804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd362538-3cb1-4f84-b1b6-eb8d66c57804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213302296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9661a7-0089-45cb-abd3-42a5b5677eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:33Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f7f7e9-8e47-4492-bda5-d3a8c63eee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f7f7e9-8e47-4492-bda5-d3a8c63eee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0c007a-ae49-48c4-8bdc-0fca1dc7e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0c007a-ae49-48c4-8bdc-0fca1dc7e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9661a7-0089-45cb-abd3-42a5b5677eb9', 'volume_name': 'volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4e758-425d-4340-8ea2-0541cfacf22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4e758-425d-4340-8ea2-0541cfacf22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcdca12-1cc9-4315-a209-57e8e7856ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:33 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Volume 1e9661a7-0089-45cb-abd3-42a5b5677eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9', 'volume_size': 1} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213302296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9661a7-0089-45cb-abd3-42a5b5677eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:33Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Creating volume 1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:33 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:33 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 1073741824 Sep 22 18:41:33 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:33 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 1073741824" returned: 0 in 0.401s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:33 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 Sep 22 18:41:33 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:33 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:33 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcdca12-1cc9-4315-a209-57e8e7856ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bdaffa-78d7-48b1-905d-22593234bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:34 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Volume volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 (1e9661a7-0089-45cb-abd3-42a5b5677eb9): created successfully Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bdaffa-78d7-48b1-905d-22593234bc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (94e6c4c2-f2d5-4be2-b732-81daa00f2ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:34 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f78b57cb-a87e-4635-bc04-b9de0fa42657 tempest-ProjectReaderTests-53104256 None] Created volume successfully. Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Creating offline snapshot b2769dcf-8fc7-428f-af26-3257eba9210d of volume 1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[51905ae0-4ee4-4da1-b439-04f55bfca0a5]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 Sep 22 18:41:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9" returned: 0 in 0.348s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:34 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:34 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d 1G Sep 22 18:41:34 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:35 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d 1G" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:35 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d Sep 22 18:41:35 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d" returned: 0 in 0.284s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:35 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d is being set with open permissions: ugo+rw Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:35 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d Sep 22 18:41:35 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:35 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d" returned: 0 in 0.239s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:35 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info Sep 22 18:41:35 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:35 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info" returned: 0 in 0.246s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:35 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info is being set with open permissions: ugo+rw Sep 22 18:41:35 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:35 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info Sep 22 18:41:35 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:36 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.info" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:36 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-73a46c96-8bd6-4a41-af7f-7904624cf713 tempest-ProjectReaderTests-53104256 None] Create snapshot completed successfully Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-b2769dcf-8fc7-428f-af26-3257eba9210d-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-b2769dcf-8fc7-428f-af26-3257eba9210d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-b2769dcf-8fc7-428f-af26-3257eba9210d" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b2769dcf-8fc7-428f-af26-3257eba9210d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Deleting offline snapshot b2769dcf-8fc7-428f-af26-3257eba9210d of volume 1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] snapshot_file for this snap is: volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1851c6-58bf-467c-a061-b6cfc414d706]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:36 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d Sep 22 18:41:36 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:36 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d" returned: 0 in 0.350s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb131a-adc7-4d41-8000-7711114ab6f2]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:36 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:37 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 Sep 22 18:41:37 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:37 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9" returned: 0 in 0.354s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:37 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d Sep 22 18:41:37 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:37 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d" returned: 0 in 0.332s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:37 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d Sep 22 18:41:37 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:37 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9.b2769dcf-8fc7-428f-af26-3257eba9210d" returned: 0 in 0.231s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b2769dcf-8fc7-428f-af26-3257eba9210d" released by "_delete_snapshot" :: held 1.362s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" released by "delete_snapshot" :: held 1.385s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:37 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Created reservations ['34ddd704-6610-487c-8f19-84d01d36c59f', '5306b545-ffe2-41e5-abab-f1db04eab737', '7a1f09ec-936e-4a02-b853-f22c727204ba', 'a43553b3-91ad-47de-b356-f45e6cae367d'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:38 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Delete snapshot completed successfully. Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-82a5aa80-225f-4a34-bb16-e658580da161 tempest-ProjectReaderTests-53104256 None] Lock "cinder-b2769dcf-8fc7-428f-af26-3257eba9210d-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-1e9661a7-0089-45cb-abd3-42a5b5677eb9-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "cinder-1e9661a7-0089-45cb-abd3-42a5b5677eb9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" acquired by "delete_volume" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[745be952-be74-4454-81bc-894ca47caafb]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:38 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:38 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 Sep 22 18:41:38 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:39 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9" returned: 0 in 0.348s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:39 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9 Sep 22 18:41:39 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:39 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-1e9661a7-0089-45cb-abd3-42a5b5677eb9" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-1e9661a7-0089-45cb-abd3-42a5b5677eb9" released by "delete_volume" :: held 0.644s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Created reservations ['1b50d874-04b9-4912-8c86-237222f22b10', 'a026f403-4d3d-462d-8918-f42fb68217f4', '63b41688-60da-4a9e-8e8a-1c56a5422e38', 'd2eb5d36-f00b-49d5-9cc9-6c79bc06fc6c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:39 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:39 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:39 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.234s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:39 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Deleted volume successfully. Sep 22 18:41:39 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e3233e57-2fff-48be-b817-7ed59ebf99ea tempest-ProjectReaderTests-53104256 None] Lock "cinder-1e9661a7-0089-45cb-abd3-42a5b5677eb9-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (26107994-0de2-4f30-8ee2-83c0e225e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3829c5-677c-404a-8632-ee1842bc3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3829c5-677c-404a-8632-ee1842bc3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803472890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c189a-fd68-411c-9675-31f9dacb6c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:40Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa042a10-d243-4c2f-8f51-4664598fed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa042a10-d243-4c2f-8f51-4664598fed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e30bebc-8ef0-494c-98b2-7670dde85d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e30bebc-8ef0-494c-98b2-7670dde85d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661c189a-fd68-411c-9675-31f9dacb6c0d', 'volume_name': 'volume-661c189a-fd68-411c-9675-31f9dacb6c0d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ef5e37-c30d-46cc-a781-ab5c6bfc280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ef5e37-c30d-46cc-a781-ab5c6bfc280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b4cb2-2043-44f1-8fbb-b39946f4af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:40 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Volume 661c189a-fd68-411c-9675-31f9dacb6c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661c189a-fd68-411c-9675-31f9dacb6c0d', 'volume_size': 1} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803472890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c189a-fd68-411c-9675-31f9dacb6c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:40Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Creating volume 661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:40 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:40 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d 1073741824 Sep 22 18:41:40 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:40 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d 1073741824" returned: 0 in 0.400s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:40 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:40 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d Sep 22 18:41:40 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:41 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d" returned: 0 in 0.258s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b4cb2-2043-44f1-8fbb-b39946f4af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661c189a-fd68-411c-9675-31f9dacb6c0d', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb48982-17b6-47e8-a640-c4f8819f1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:41 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Volume volume-661c189a-fd68-411c-9675-31f9dacb6c0d (661c189a-fd68-411c-9675-31f9dacb6c0d): created successfully Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb48982-17b6-47e8-a640-c4f8819f1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (26107994-0de2-4f30-8ee2-83c0e225e703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:41 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-657145f6-0eb2-47fb-b317-a69596b2aa48 tempest-ProjectReaderTests-53104256 None] Created volume successfully. Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Creating offline snapshot f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 of volume 661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345d553-6ed1-49bf-958e-61af60d4d407]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:41 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d Sep 22 18:41:41 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:41 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d" returned: 0 in 0.345s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:41 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:41 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 1G Sep 22 18:41:41 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:42 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 1G" returned: 0 in 0.437s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661c189a-fd68-411c-9675-31f9dacb6c0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:42 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661c189a-fd68-411c-9675-31f9dacb6c0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 Sep 22 18:41:42 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:42 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661c189a-fd68-411c-9675-31f9dacb6c0d -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" returned: 0 in 0.288s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:42 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 is being set with open permissions: ugo+rw Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:42 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 Sep 22 18:41:42 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:42 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" returned: 0 in 0.234s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:42 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info Sep 22 18:41:42 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:43 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info" returned: 0 in 0.241s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:43 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info is being set with open permissions: ugo+rw Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:43 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info Sep 22 18:41:43 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:43 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.info" returned: 0 in 0.227s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:43 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f44ef9a9-8c67-48fc-badf-9ef7c170f4e5 tempest-ProjectReaderTests-53104256 None] Create snapshot completed successfully Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Deleting offline snapshot f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 of volume 661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] snapshot_file for this snap is: volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cfb8d0-d3f1-4763-905a-f3ed5684e115]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:43 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:43 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 Sep 22 18:41:43 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:44 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" returned: 0 in 0.353s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-661c189a-fd68-411c-9675-31f9dacb6c0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb2b3a3-18fb-4f38-8914-b94918cd252c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:44 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d Sep 22 18:41:44 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:44 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:44 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 Sep 22 18:41:44 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:44 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" returned: 0 in 0.326s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:44 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6 Sep 22 18:41:44 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:44 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d.f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" returned: 0 in 0.232s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:44 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6" released by "_delete_snapshot" :: held 1.359s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" released by "delete_snapshot" :: held 1.380s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Created reservations ['6ae1568a-8899-4c55-8986-7ed662aac6c9', '4cb9c54d-ce74-48b7-a705-150196ebdedc', '06e2cb56-ab9e-4607-99c4-a5295afe6417', 'b948e823-624a-4de6-9357-769a1b84688c'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:45 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Delete snapshot completed successfully. Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-e8ea1929-cf67-4b66-a489-ced591b6bd55 tempest-ProjectReaderTests-53104256 None] Lock "cinder-f3508148-cba2-4aaf-a7ce-5ebcc75f49b6-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-661c189a-fd68-411c-9675-31f9dacb6c0d-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "cinder-661c189a-fd68-411c-9675-31f9dacb6c0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f4225-9e34-4f21-9e2b-c8615c1d9281]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:45 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:45 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d Sep 22 18:41:45 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:46 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d" returned: 0 in 0.377s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:46 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d Sep 22 18:41:46 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:46 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-661c189a-fd68-411c-9675-31f9dacb6c0d" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-661c189a-fd68-411c-9675-31f9dacb6c0d" released by "delete_volume" :: held 0.672s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Created reservations ['b29d0169-8153-44ef-8aa7-3ae8685288f3', 'ad1c1220-70ce-447a-ba78-b8f241389581', '0c7bf8e9-213b-44fe-8224-7faa8a34afa2', '31e0c8ee-c6f4-4f15-8970-d259d5591037'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:46 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:46 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:46 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.253s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:46 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Deleted volume successfully. Sep 22 18:41:46 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-5cf285e9-0c1a-4acf-8d5d-2a6ff42de9bf tempest-ProjectReaderTests-53104256 None] Lock "cinder-661c189a-fd68-411c-9675-31f9dacb6c0d-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (f99671dc-533f-47b5-998f-08731dc13ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc59459-2627-4c87-b09b-86a4c0c1d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc59459-2627-4c87-b09b-86a4c0c1d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244938158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bac9cb8-38a9-46a3-917c-0171d86bed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:47Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbf8cab-80d4-4ebc-a07a-5e07c8a75788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbf8cab-80d4-4ebc-a07a-5e07c8a75788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed175844-6802-4e59-9845-ddd9d0d734ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed175844-6802-4e59-9845-ddd9d0d734ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bac9cb8-38a9-46a3-917c-0171d86bed3e', 'volume_name': 'volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b716e8-13c4-4fd6-9c3e-158331f71346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b716e8-13c4-4fd6-9c3e-158331f71346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71cb3b1-e394-4d81-981e-4bd58233082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:47 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Volume 2bac9cb8-38a9-46a3-917c-0171d86bed3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e', 'volume_size': 1} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244938158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bac9cb8-38a9-46a3-917c-0171d86bed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:47Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Creating volume 2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:47 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:47 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e 1073741824 Sep 22 18:41:47 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:47 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e 1073741824" returned: 0 in 0.404s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:47 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:47 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e Sep 22 18:41:47 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:48 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e" returned: 0 in 0.249s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71cb3b1-e394-4d81-981e-4bd58233082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f5f925-5708-4859-8b8b-ccd5cceea33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:48 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Volume volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e (2bac9cb8-38a9-46a3-917c-0171d86bed3e): created successfully Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f5f925-5708-4859-8b8b-ccd5cceea33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (f99671dc-533f-47b5-998f-08731dc13ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:48 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cf479d1b-b0d6-4654-8a32-94a3d08830db tempest-ProjectReaderTests-53104256 None] Created volume successfully. Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:48 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:48 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Creating offline snapshot a19198e9-9c17-4ff3-8ff9-0999c6b03c32 of volume 2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d554d52-48bc-4843-973a-61e7f74678c6]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:48 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e Sep 22 18:41:48 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:48 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 22 18:41:48 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:49 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 1G Sep 22 18:41:49 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:49 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 1G" returned: 0 in 0.377s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:49 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 Sep 22 18:41:49 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:49 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32" returned: 0 in 0.273s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:49 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 is being set with open permissions: ugo+rw Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:49 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 Sep 22 18:41:49 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:49 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32" returned: 0 in 0.232s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:49 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:49 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info Sep 22 18:41:49 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:50 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info" returned: 0 in 0.240s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:50 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info is being set with open permissions: ugo+rw Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:50 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info Sep 22 18:41:50 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:50 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.info" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.799s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:50 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-791785de-304e-4825-831e-3e6446e47fd2 tempest-ProjectReaderTests-53104256 None] Create snapshot completed successfully Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-a19198e9-9c17-4ff3-8ff9-0999c6b03c32-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-a19198e9-9c17-4ff3-8ff9-0999c6b03c32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-a19198e9-9c17-4ff3-8ff9-0999c6b03c32" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-a19198e9-9c17-4ff3-8ff9-0999c6b03c32" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Deleting offline snapshot a19198e9-9c17-4ff3-8ff9-0999c6b03c32 of volume 2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] snapshot_file for this snap is: volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0471e7-6b46-45e8-8efe-5e3db24b5013]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:50 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:50 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 Sep 22 18:41:50 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:51 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32" returned: 0 in 0.358s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b3388-1c2a-41c5-826a-ce79719c0b2c]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:51 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e Sep 22 18:41:51 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:51 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e" returned: 0 in 0.338s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:51 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 Sep 22 18:41:51 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:51 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32" returned: 0 in 0.331s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:51 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:51 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32 Sep 22 18:41:51 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:52 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e.a19198e9-9c17-4ff3-8ff9-0999c6b03c32" returned: 0 in 0.251s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-a19198e9-9c17-4ff3-8ff9-0999c6b03c32" released by "_delete_snapshot" :: held 1.366s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" released by "delete_snapshot" :: held 1.387s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:INSERT=39,cinder:UPDATE=147,cinder:SELECT=110,cinder:DELETE=14 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=114,cinder:INSERT=41,cinder:UPDATE=141,cinder:DELETE=10 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Created reservations ['5b440b9a-2378-4341-bb48-c183be2a19c0', '854612c8-4770-4dd5-a934-2df7e55d8bee', 'ab521fee-25cc-49b3-a323-c87ce4d86c40', '8e5fd956-a836-438a-9b21-4b0cb6eac49a'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:52 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Delete snapshot completed successfully. Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-1ea5c011-d2cc-4583-969a-fd848a1ce6ee tempest-ProjectReaderTests-53104256 None] Lock "cinder-a19198e9-9c17-4ff3-8ff9-0999c6b03c32-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-2bac9cb8-38a9-46a3-917c-0171d86bed3e-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "cinder-2bac9cb8-38a9-46a3-917c-0171d86bed3e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b93a7-56e5-4a52-9b4d-bf91f3005d12]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:52 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:53 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e Sep 22 18:41:53 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:53 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e" returned: 0 in 0.381s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:53 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e Sep 22 18:41:53 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:53 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-2bac9cb8-38a9-46a3-917c-0171d86bed3e" returned: 0 in 0.265s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-2bac9cb8-38a9-46a3-917c-0171d86bed3e" released by "delete_volume" :: held 0.706s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Created reservations ['463f5712-ad8a-4c15-8f8e-5545ddc436b0', '60bee074-5fb1-4c4f-a349-eee5e10b844f', '21428aa7-1a35-4e2b-b116-5ce52a650b34', '8e49532a-b261-4106-97df-a56c05f529ba'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:53 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:53 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:41:53 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:54 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.263s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:41:54 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Deleted volume successfully. Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-0e693d4d-cb05-4f1d-8cc3-f244a9bf77b3 tempest-ProjectReaderTests-53104256 None] Lock "cinder-2bac9cb8-38a9-46a3-917c-0171d86bed3e-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (bfa74cc4-552e-41ba-9c48-e2bcd115e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d515a0-cda0-482b-aae5-d4be1124c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d515a0-cda0-482b-aae5-d4be1124c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825053646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c04f85-31ef-49ad-aca3-df172d43fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:54Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6830a1-eb50-4194-8d48-d0eefe5cf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6830a1-eb50-4194-8d48-d0eefe5cf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0bb58c-78b0-497e-8401-1551299a5b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0bb58c-78b0-497e-8401-1551299a5b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c04f85-31ef-49ad-aca3-df172d43fb10', 'volume_name': 'volume-b9c04f85-31ef-49ad-aca3-df172d43fb10', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b7b1a6-bb26-49a4-aa8a-beec4519db68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b7b1a6-bb26-49a4-aa8a-beec4519db68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13074a93-c6c0-4aa9-8fe1-5ec8270fff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:54 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Volume b9c04f85-31ef-49ad-aca3-df172d43fb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c04f85-31ef-49ad-aca3-df172d43fb10', 'volume_size': 1} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825053646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c04f85-31ef-49ad-aca3-df172d43fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ce8363012e43a6ae9528905713a0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:41:54Z,use_quota=True,user_id='16c24f38300a45aa9e4ab608a7d32595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Creating volume b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:41:54 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:54 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 1073741824 Sep 22 18:41:54 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:54 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 1073741824" returned: 0 in 0.387s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:54 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:54 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 Sep 22 18:41:54 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:55 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10" returned: 0 in 0.261s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13074a93-c6c0-4aa9-8fe1-5ec8270fff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c04f85-31ef-49ad-aca3-df172d43fb10', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703f5442-f02a-4d6a-a00a-8e79b8817e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:41:55 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Volume volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 (b9c04f85-31ef-49ad-aca3-df172d43fb10): created successfully Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703f5442-f02a-4d6a-a00a-8e79b8817e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Flow 'volume_create_manager' (bfa74cc4-552e-41ba-9c48-e2bcd115e238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:41:55 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f6ef47b6-4d53-44bb-a219-c73a313b7297 tempest-ProjectReaderTests-53104256 None] Created volume successfully. Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Creating offline snapshot dc81cb02-0269-44ed-9ebf-c321295f87d4 of volume b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d3f44-c79a-477c-a157-332ffbe07ffe]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:55 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:55 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 Sep 22 18:41:55 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:56 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10" returned: 0 in 0.361s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 1G {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:56 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 1G Sep 22 18:41:56 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:56 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 1G" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:56 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 Sep 22 18:41:56 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:56 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 -F qcow2 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4" returned: 0 in 0.308s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:56 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 is being set with open permissions: ugo+rw Sep 22 18:41:56 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:56 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 Sep 22 18:41:56 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:57 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:57 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info Sep 22 18:41:57 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:57 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:57 devstack cinder-volume[86046]: WARNING cinder.volume.drivers.remotefs [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info is being set with open permissions: ugo+rw Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:57 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info Sep 22 18:41:57 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:57 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.info" returned: 0 in 0.238s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:41:57 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-fb292415-cb0e-423c-aca3-d22d32d5df2e tempest-ProjectReaderTests-53104256 None] Create snapshot completed successfully Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-dc81cb02-0269-44ed-9ebf-c321295f87d4-delete_snapshot" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-dc81cb02-0269-44ed-9ebf-c321295f87d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" by "delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-dc81cb02-0269-44ed-9ebf-c321295f87d4" by "_delete_snapshot" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-dc81cb02-0269-44ed-9ebf-c321295f87d4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Deleting offline snapshot dc81cb02-0269-44ed-9ebf-c321295f87d4 of volume b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] snapshot_file for this snap is: volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca80743-4bc5-4b33-90fa-405861e31878]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:57 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:57 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 Sep 22 18:41:57 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:58 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4" returned: 0 in 0.347s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c04f85-31ef-49ad-aca3-df172d43fb10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10b6b28-cbf3-477e-8bdb-ef546a63b96d]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:58 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 Sep 22 18:41:58 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:58 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10" returned: 0 in 0.360s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:58 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 Sep 22 18:41:58 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:58 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4" returned: 0 in 0.328s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:58 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:41:58 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4 Sep 22 18:41:58 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:41:59 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10.dc81cb02-0269-44ed-9ebf-c321295f87d4" returned: 0 in 0.247s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-dc81cb02-0269-44ed-9ebf-c321295f87d4" released by "_delete_snapshot" :: held 1.377s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" released by "delete_snapshot" :: held 1.400s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Created reservations ['595a7718-9e61-4949-a911-1830fb8dce95', '18b33f60-8100-45f4-84f7-c301b3eeabb2', '22c879d2-02d1-4fce-814b-543741cb6df3', 'bbd9092a-0c78-48ee-af77-7ac929a02f37'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:41:59 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Delete snapshot completed successfully. Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-227ad6b6-327b-49e3-bd05-c01705d181fa tempest-ProjectReaderTests-53104256 None] Lock "cinder-dc81cb02-0269-44ed-9ebf-c321295f87d4-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-b9c04f85-31ef-49ad-aca3-df172d43fb10-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "cinder-b9c04f85-31ef-49ad-aca3-df172d43fb10-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Acquiring lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:41:59 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" acquired by "delete_volume" :: waited 0.018s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3dc95-c697-466b-87c6-fa7e67d72021]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:00 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 Sep 22 18:42:00 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:00 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10" returned: 0 in 0.366s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:00 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10 Sep 22 18:42:00 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:00 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-b9c04f85-31ef-49ad-aca3-df172d43fb10" returned: 0 in 0.243s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "cinder-quobyte-b9c04f85-31ef-49ad-aca3-df172d43fb10" released by "delete_volume" :: held 0.675s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Created reservations ['3e2e73f4-7bc8-4e2f-8c8c-15e5dd6edd4f', '3753f24f-a551-461e-ac8b-4e9a134c5dff', 'af370bf2-3d45-4dee-8d1c-dbb02ff64c3b', 'd8e163ca-c96a-4f38-a72a-d1cd6deaa20e'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:00 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:00 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:00 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:01 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:01 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:01 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:01 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Deleted volume successfully. Sep 22 18:42:01 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-c5d90901-3c8e-4199-9cc5-8d810630e49d tempest-ProjectReaderTests-53104256 None] Lock "cinder-b9c04f85-31ef-49ad-aca3-df172d43fb10-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (e464c853-b72b-41ae-ab39-1973fb760ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d640ab-bda1-4153-8bef-a6606b96e449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d640ab-bda1-4153-8bef-a6606b96e449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514265987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d55dfa-2d33-4008-aef1-1a701d3f0934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:05Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29ec162-3665-45d5-9255-2b3382ae22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29ec162-3665-45d5-9255-2b3382ae22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15efc3c1-4f45-4a8e-9b07-e365c7558328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15efc3c1-4f45-4a8e-9b07-e365c7558328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d55dfa-2d33-4008-aef1-1a701d3f0934', 'volume_name': 'volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bee245-6951-42e1-b3f5-f047250b4636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bee245-6951-42e1-b3f5-f047250b4636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6dba5-0948-4b71-a7a1-bf5141506ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:04 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Volume e6d55dfa-2d33-4008-aef1-1a701d3f0934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934', 'volume_size': 1} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514265987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d55dfa-2d33-4008-aef1-1a701d3f0934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:05Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Creating volume e6d55dfa-2d33-4008-aef1-1a701d3f0934 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:42:04 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:42:04 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:04 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 1073741824 Sep 22 18:42:04 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:05 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 1073741824" returned: 0 in 0.448s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:05 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 Sep 22 18:42:05 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:05 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934" returned: 0 in 0.254s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6dba5-0948-4b71-a7a1-bf5141506ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd250a9-3121-410d-b0dd-40624661332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:05 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Volume volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 (e6d55dfa-2d33-4008-aef1-1a701d3f0934): created successfully Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd250a9-3121-410d-b0dd-40624661332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (e464c853-b72b-41ae-ab39-1973fb760ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:05 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-37d3dc8e-a5b6-446b-8cfb-0f7b2d081cfa tempest-ProjectReaderTests-1041739801 None] Created volume successfully. Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-e6d55dfa-2d33-4008-aef1-1a701d3f0934-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-e6d55dfa-2d33-4008-aef1-1a701d3f0934-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-quobyte-e6d55dfa-2d33-4008-aef1-1a701d3f0934" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:05 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-e6d55dfa-2d33-4008-aef1-1a701d3f0934" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69100778-f39c-411a-a543-b4cbdea6d116]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:06 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 Sep 22 18:42:06 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:06 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934" returned: 0 in 0.384s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:06 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934 Sep 22 18:42:06 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:06 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e6d55dfa-2d33-4008-aef1-1a701d3f0934" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-e6d55dfa-2d33-4008-aef1-1a701d3f0934" released by "delete_volume" :: held 0.678s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Created reservations ['ce48fb89-61cf-40fc-93fd-35d0ebb1fe4e', '72cf93e1-cf5e-405e-bfce-57ba80891622', 'e43aa55f-b85c-439e-8c21-bba7e355edcd', 'c833aeb5-fac2-40a1-b5d6-22c4df083b92'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:06 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:06 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:06 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:07 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.232s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:07 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Deleted volume successfully. Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-b93e7c33-9843-466d-b40f-0898a6418c6d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-e6d55dfa-2d33-4008-aef1-1a701d3f0934-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (ef01762f-5520-480d-a754-f3590c2c4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eda79c-7d99-4dc0-8146-fb384269aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eda79c-7d99-4dc0-8146-fb384269aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475699258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7b0c25-2b82-471d-afdb-718dff0ff9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:08Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b72e23e-8862-4300-af7c-1cddca1d7517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b72e23e-8862-4300-af7c-1cddca1d7517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608aa858-614b-4cfe-b539-2719bbf37f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608aa858-614b-4cfe-b539-2719bbf37f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7b0c25-2b82-471d-afdb-718dff0ff9d6', 'volume_name': 'volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3aeb8f-be9f-48e0-ba9b-1cacdd6ceabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3aeb8f-be9f-48e0-ba9b-1cacdd6ceabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921f679-0cd3-4645-b6e9-082d621fe250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:07 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Volume 7a7b0c25-2b82-471d-afdb-718dff0ff9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6', 'volume_size': 1} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475699258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7b0c25-2b82-471d-afdb-718dff0ff9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:08Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Creating volume 7a7b0c25-2b82-471d-afdb-718dff0ff9d6 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:42:07 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:42:07 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:07 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 1073741824 Sep 22 18:42:07 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:08 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 1073741824" returned: 0 in 0.408s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:08 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 Sep 22 18:42:08 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:08 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" returned: 0 in 0.242s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921f679-0cd3-4645-b6e9-082d621fe250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fba013-fbf1-40c8-9013-d4c5fd562265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:08 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Volume volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 (7a7b0c25-2b82-471d-afdb-718dff0ff9d6): created successfully Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fba013-fbf1-40c8-9013-d4c5fd562265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (ef01762f-5520-480d-a754-f3590c2c4c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:08 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-a5debd16-6095-4ea0-8661-8ff236d3d250 tempest-ProjectReaderTests-1041739801 None] Created volume successfully. Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-7a7b0c25-2b82-471d-afdb-718dff0ff9d6-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-7a7b0c25-2b82-471d-afdb-718dff0ff9d6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-quobyte-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae9303-7150-49b9-a67b-517d88220b4e]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:42:08 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:08 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 Sep 22 18:42:08 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:09 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" returned: 0 in 0.337s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:09 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6 Sep 22 18:42:09 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:09 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-7a7b0c25-2b82-471d-afdb-718dff0ff9d6" released by "delete_volume" :: held 0.615s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Created reservations ['2678c7d2-6855-4e5c-82d6-ea0c64736190', '4d7523fa-997d-4e49-9431-850112adb0c9', '20229d93-ae42-4025-8a8f-289a9d93e14d', '38c8dea5-5641-46b8-9fc0-6038d141e235'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:09 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:09 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:09 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.248s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:09 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Deleted volume successfully. Sep 22 18:42:09 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-50deb899-3727-439e-8acb-7c9b3094e479 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-7a7b0c25-2b82-471d-afdb-718dff0ff9d6-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (66005236-c6e3-4832-abdc-3e0faf125bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4e7d2a-edee-44bb-9437-5d69e0cc4903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4e7d2a-edee-44bb-9437-5d69e0cc4903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775064920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97d0af9-6394-46c0-81c3-5cecef725b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:10Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b6dccc-5146-4a04-b178-1b36c847933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b6dccc-5146-4a04-b178-1b36c847933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f50dd-b2b9-40bb-ac74-48deac75d163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f50dd-b2b9-40bb-ac74-48deac75d163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97d0af9-6394-46c0-81c3-5cecef725b95', 'volume_name': 'volume-e97d0af9-6394-46c0-81c3-5cecef725b95', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db96e40-71c8-429a-9c27-858b403b348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db96e40-71c8-429a-9c27-858b403b348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205e143-2180-415a-9320-3b4df26473b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Volume e97d0af9-6394-46c0-81c3-5cecef725b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97d0af9-6394-46c0-81c3-5cecef725b95', 'volume_size': 1} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775064920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97d0af9-6394-46c0-81c3-5cecef725b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:10Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Creating volume e97d0af9-6394-46c0-81c3-5cecef725b95 {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:42:10 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:10 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 1073741824 Sep 22 18:42:10 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:10 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 1073741824" returned: 0 in 0.407s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:10 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 Sep 22 18:42:10 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:10 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95" returned: 0 in 0.235s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205e143-2180-415a-9320-3b4df26473b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97d0af9-6394-46c0-81c3-5cecef725b95', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:10 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdcb8eb-c4a0-4c8b-bc47-1eac76ccaf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:10 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Volume volume-e97d0af9-6394-46c0-81c3-5cecef725b95 (e97d0af9-6394-46c0-81c3-5cecef725b95): created successfully Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdcb8eb-c4a0-4c8b-bc47-1eac76ccaf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (66005236-c6e3-4832-abdc-3e0faf125bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:11 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-7e321be7-874f-4370-8dea-593e25dccaf4 tempest-ProjectReaderTests-1041739801 None] Created volume successfully. Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-e97d0af9-6394-46c0-81c3-5cecef725b95-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-e97d0af9-6394-46c0-81c3-5cecef725b95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-quobyte-e97d0af9-6394-46c0-81c3-5cecef725b95" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-e97d0af9-6394-46c0-81c3-5cecef725b95" acquired by "delete_volume" :: waited 0.016s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fec589-4c1b-4f3c-8f47-eb8d9f3417ba]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:11 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 Sep 22 18:42:11 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:11 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95" returned: 0 in 0.355s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:11 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:11 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95 Sep 22 18:42:11 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:12 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-e97d0af9-6394-46c0-81c3-5cecef725b95" returned: 0 in 0.250s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-e97d0af9-6394-46c0-81c3-5cecef725b95" released by "delete_volume" :: held 0.646s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Created reservations ['1d78e9bf-f915-4574-87c5-a1d99653160a', '636166f0-c2d6-46ef-9101-f7c1875789aa', '7bbf332a-83f3-4474-a928-8681fb3103e5', 'c19ddc68-c204-4cec-a35f-94262d1f6ae2'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:12 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:12 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:12 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.256s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:12 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Deleted volume successfully. Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-f420dff9-58fb-49a5-8a9d-78cd7093da5d tempest-ProjectReaderTests-1041739801 None] Lock "cinder-e97d0af9-6394-46c0-81c3-5cecef725b95-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (ffd3a54a-de74-4aa6-971f-ac1c3366a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b19c34-afd2-4272-9a39-bfc7f109412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b19c34-afd2-4272-9a39-bfc7f109412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818065371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8549f0b1-ed1b-4632-8c0e-f8d0c1a813be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:13Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad56250-034c-40a4-b672-758acc83dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad56250-034c-40a4-b672-758acc83dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d66ad0-510c-43a0-aeda-f2fe0c2f2908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d66ad0-510c-43a0-aeda-f2fe0c2f2908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8549f0b1-ed1b-4632-8c0e-f8d0c1a813be', 'volume_name': 'volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15c66d-cbc1-4047-9613-76c6798950c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15c66d-cbc1-4047-9613-76c6798950c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e50e908-25d6-4193-9cf1-99362bc908c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:12 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Volume 8549f0b1-ed1b-4632-8c0e-f8d0c1a813be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be', 'volume_size': 1} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T16:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818065371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8549f0b1-ed1b-4632-8c0e-f8d0c1a813be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c49b9ea0654a92bdf57080ff622020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T16:42:13Z,use_quota=True,user_id='0329ae7ba1654b58bdd5ddf890cb44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54de9684-841f-4a56-8455-c6673edd9d1a),volume_type_id=54de9684-841f-4a56-8455-c6673edd9d1a)}" {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.remotefs [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Creating volume 8549f0b1-ed1b-4632-8c0e-f8d0c1a813be {{(pid=86046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Selected osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 as target Quobyte volume. {{(pid=86046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 22 18:42:12 devstack cinder-volume[86046]: INFO cinder.volume.drivers.remotefs [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] casted to osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4 Sep 22 18:42:12 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be 1073741824 {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:12 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be 1073741824 Sep 22 18:42:12 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:13 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be 1073741824" returned: 0 in 0.411s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:13 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be Sep 22 18:42:13 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:13 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'} {{(pid=86046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e50e908-25d6-4193-9cf1-99362bc908c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be', 'volume_size': 1}' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:13 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b92e13-6857-42ce-81ee-c1f573ce5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 22 18:42:14 devstack cinder-volume[86046]: INFO cinder.volume.flows.manager.create_volume [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Volume volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be (8549f0b1-ed1b-4632-8c0e-f8d0c1a813be): created successfully Sep 22 18:42:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b92e13-6857-42ce-81ee-c1f573ce5e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86046) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 22 18:42:14 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Flow 'volume_create_manager' (ffd3a54a-de74-4aa6-971f-ac1c3366a82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86046) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 22 18:42:17 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-ab6fbeed-b1b3-43db-950a-a946077b3e52 tempest-ProjectReaderTests-1041739801 None] Created volume successfully. Sep 22 18:42:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be-delete_volume" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "cinder-quobyte-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" by "delete_volume" {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 22 18:42:18 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" acquired by "delete_volume" :: waited 0.017s {{(pid=86046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087a708-499d-4ed4-96d9-944a17f91dae]: (4, 'qcow2') {{(pid=87225) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:19 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be Sep 22 18:42:19 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:19 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" returned: 0 in 0.374s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:19 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be Sep 22 18:42:19 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:19 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a/volume-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" returned: 0 in 0.237s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-quobyte-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be" released by "delete_volume" :: held 0.662s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG cinder.quota [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Created reservations ['393c1924-5bea-4d3b-b0af-131c765924f5', '0704d2c4-1f3a-46f7-b29a-a6dae2a05d31', '7466dc47-3c35-43a8-aa5e-287f4ffa94d3', '00bfdf8c-da85-4273-bacf-64106b01fc11'] {{(pid=86046) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:19 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:19 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:19 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:20 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:20 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.257s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:20 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:20 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Deleted volume successfully. Sep 22 18:42:20 devstack cinder-volume[86046]: DEBUG cinder.coordination [None req-d1d91bef-d22d-4c33-81db-684796096448 tempest-ProjectReaderTests-1041739801 None] Lock "cinder-8549f0b1-ed1b-4632-8c0e-f8d0c1a813be-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=86046) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 22 18:42:29 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:INSERT=17,cinder:UPDATE=70,cinder:SELECT=54,cinder:DELETE=6 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:42:30 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=47,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4': None} {{(pid=86046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG cinder.volume.drivers.quobyte [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ac3804f-4f06-4b76-902d-2d18ff782dc4'] {{(pid=86046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86046) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 22 18:42:48 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a Sep 22 18:42:48 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 18:42:48 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_concurrency.processutils [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f3cf6c7fb26c6dc3a1a6cf761f3be16a" returned: 0 in 0.252s {{(pid=86046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG cinder.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Notifying Schedulers of capabilities ... {{(pid=86046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG oslo_service.periodic_task [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] Running periodic task VolumeManager._thread_info {{(pid=86046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread count: 29 {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 22 18:42:48 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-43de7ac4-f25d-4320-9f20-618188f9b2fa None None] thread info: [<_MainThread(MainThread, started 135638439067776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}